2026-09-01T00:14:32,823 Created temporary directory: /tmp/pip-ephem-wheel-cache-a_u6pzif 2026-09-01T00:14:32,824 Created temporary directory: /tmp/pip-build-tracker-6udn2v18 2026-09-01T00:14:32,825 Initialized build tracking at /tmp/pip-build-tracker-6udn2v18 2026-09-01T00:14:32,825 Created build tracker: /tmp/pip-build-tracker-6udn2v18 2026-09-01T00:14:32,826 Entered build tracker: /tmp/pip-build-tracker-6udn2v18 2026-09-01T00:14:32,827 Created temporary directory: /tmp/pip-wheel-149vc3qs 2026-09-01T00:14:32,830 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-09-01T00:14:32,832 Created temporary directory: /tmp/pip-ephem-wheel-cache-0m8nbhch 2026-09-01T00:14:32,854 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-09-01T00:14:32,857 2 location(s) to search for versions of lm-eval: 2026-09-01T00:14:32,857 * https://pypi.org/simple/lm-eval/ 2026-09-01T00:14:32,857 * https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:14:32,858 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/ 2026-09-01T00:14:32,859 Getting page https://pypi.org/simple/lm-eval/ 2026-09-01T00:14:32,860 Found index url https://pypi.org/simple 2026-09-01T00:14:33,017 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json 2026-09-01T00:14:33,025 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:14:33,026 Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1 2026-09-01T00:14:33,027 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:14:33,028 Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0 2026-09-01T00:14:33,028 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:14:33,029 Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0 2026-09-01T00:14:33,030 Found link https://files.pythonhosted.org/packages/45/e0/05001c2e56e2f8f793189442176432ddb89a2f1f1ef00ea154d0bc00fe37/lm_eval-0.4.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.0 2026-09-01T00:14:33,031 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/49/2d/39f7a25ab663cb45cfc7773b85980f01df44853cc427d00dce94c90b43e6/lm_eval-0.4.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,031 Found link https://files.pythonhosted.org/packages/5a/02/1c7f1ac2f139f4c05af5b94e2c4f88a70404fa0b0c22a5fb04dec0216b03/lm_eval-0.4.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.1 2026-09-01T00:14:33,032 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/0c/5a/64cf703b62ac7ada09a514c16c7136bb4ea7ef3030eb4c3d780900a5a634/lm_eval-0.4.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,033 Found link https://files.pythonhosted.org/packages/75/ca/18814743ba3b42d19d8524a4f771e9c3a7aa02cd4c579747a0f513907205/lm_eval-0.4.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.2 2026-09-01T00:14:33,034 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/39/2b/eb15fb57ba48b3cebfd302713d680d9917101867e2b5fbfd266e88b89ff3/lm_eval-0.4.3-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,035 Found link https://files.pythonhosted.org/packages/2e/69/dbff28f17e17521735460b25645479e85b58d8ad7ea8488e4672ab52b58b/lm_eval-0.4.3.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.3 2026-09-01T00:14:33,035 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/ad/e1/ac8d7d26b4d6a9eea8859d438691b5d8209a37be2117b3e61f247de2d9e7/lm_eval-0.4.4-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,036 Found link https://files.pythonhosted.org/packages/c6/a8/4dcffd9ad0ddb6c479f93d8316a108a6f9b4d81756c892f150b6c307e8d4/lm_eval-0.4.4.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.4 2026-09-01T00:14:33,037 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c1/78/fb3ea82c77ccc4dbbd6cafceb15ca01c1cd4d778217d572d65c919b0643f/lm_eval-0.4.5-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,037 Found link https://files.pythonhosted.org/packages/68/7a/cb1993a8d217a5b4c6e52f612a677c4f02c3412d2e3093ecbf6f6413136c/lm_eval-0.4.5.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.5 2026-09-01T00:14:33,038 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/45/b9/1b4e3268b590d9ff16e087685d9526455bb677c3e4d0caeba4451f20c586/lm_eval-0.4.7-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,039 Found link https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.7 2026-09-01T00:14:33,039 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c3/0b/36d6117f644f3685e6b87005ecd7051d01e9cdcf617e8e671102c1546de2/lm_eval-0.4.8-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:14:33,040 Found link https://files.pythonhosted.org/packages/ba/b2/fe23d318c5f645636f9f776c373d1ba68aa55c998894660613a09b0fe2ec/lm_eval-0.4.8.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.8 2026-09-01T00:14:33,041 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/b6/4f/3ab58de3dfee26f693d149824d9d62723f771392c4756becccbcbaaa4e03/lm_eval-0.4.9-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:14:33,042 Found link https://files.pythonhosted.org/packages/e5/ab/866d8957cddbb26510e5cf5f7c5ec01e179f82d54d2dafd3a6c5c31fc200/lm_eval-0.4.9.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9 2026-09-01T00:14:33,042 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/18/ba/3a992d435deaf5461f50417bd7ba38a21831a04520941a9ecf1020dcf900/lm_eval-0.4.9.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:14:33,043 Found link https://files.pythonhosted.org/packages/b9/81/943efd4d008080625ddb135d961fc40e78fa75c61f4ce1b4b1244c667571/lm_eval-0.4.9.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.9), version: 0.4.9.1 2026-09-01T00:14:33,044 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/6c/50/3903694e69c94ae8dcec654843cb99799e45137e0d1a0a581009aa592673/lm_eval-0.4.9.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,045 Found link https://files.pythonhosted.org/packages/e1/5e/e6d70f4aa2acd7932a873c51de93ddf2dbd1c43aa6f6c86314ab3c0d279d/lm_eval-0.4.9.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.9.2 2026-09-01T00:14:33,045 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/23/5b/d0762a01f140e945aa7a44c92bb0c5c149c2c2917278c02eef6f5053b8e1/lm_eval-0.4.10-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,046 Found link https://files.pythonhosted.org/packages/7c/1c/858cc03ac7960bc7a1323d40a0d912ebef560825075504238f6721ad8a3a/lm_eval-0.4.10.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.10 2026-09-01T00:14:33,047 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/df/b3/8c2923ad4c4d911307e20ab9c7d7869d3811b5a76fe6dbe53678aafbeb04/lm_eval-0.4.11-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,047 Found link https://files.pythonhosted.org/packages/18/40/ad60ae17f97902ba4ee67914a94c159552f8643fb4598d1d2430a571f0a2/lm_eval-0.4.11.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.11 2026-09-01T00:14:33,048 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/bd/43/944724465ed73ec2889f58007c114ce8dd2023324bc86d3e6f41ce00e2e8/lm_eval-0.4.12-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,049 Found link https://files.pythonhosted.org/packages/12/32/783623b1d1fe7c89ebd774db46bef4c787fe93e7c5e1b4877c7dfbf1abbe/lm_eval-0.4.12.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.12 2026-09-01T00:14:33,049 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/03/da/b9a60f1d746cf1d79c0abc414409e149cea611532bab70811775d581be1e/lm_eval-0.4.13.dev0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,050 Found link https://files.pythonhosted.org/packages/6d/6d/e8bae20c63575c7d8939ebb0e6f22b9dc287f42a9d0f0a39523a186121ca/lm_eval-0.4.13.dev0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.13.dev0 2026-09-01T00:14:33,051 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/7d/e8/e90272ef920d5a77c91bf0473e325113950f37bfeaca2fa3b98e16142961/lm_eval-0.4.13-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,051 Found link https://files.pythonhosted.org/packages/89/b1/cfcdf2a8c8b8e755ec7103a7d4b6f8673f7916641ca08df83412c531935b/lm_eval-0.4.13.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.4.13 2026-09-01T00:14:33,052 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f4/dc/8dc6e399a1e97948064a571639ad5b3f2b7cae84f930dae081e49bcafd47/lm_eval-0.5.0.dev1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,053 Found link https://files.pythonhosted.org/packages/65/41/26141271560b0a41e2279fe2a2f29bf75e26cfb93849e3d5ad68c28ba66b/lm_eval-0.5.0.dev1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.10), version: 0.5.0.dev1 2026-09-01T00:14:33,054 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:14:33,054 Getting page https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:14:33,055 Found index url https://www.piwheels.org/simple 2026-09-01T00:14:33,250 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html 2026-09-01T00:14:33,256 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.5.0.dev1-py3-none-any.whl#sha256=2b123742db0404ed529819f64cdd873004c66e5d8ad3d552a5e5c5f7f216d246 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,257 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.12-py3-none-any.whl#sha256=fcb805fe553443c0365cbb87826c85649f35c9f7d40fb07e0272f8629b90cb01 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,258 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.11-py3-none-any.whl#sha256=7a994cec7f884dff2892c895be7943f2e5daf899d1a0c96862a09e86d38317ef (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,258 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.10-py3-none-any.whl#sha256=f974c8439950d7e007710fae43c1ff085ba2724b8c9c29456987c442a14ddc4a (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,259 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9.2-py3-none-any.whl#sha256=6433acae848f5040a05aec1f8b4d946c1874207195592064a0dccbf11e6a3bf7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.10) 2026-09-01T00:14:33,259 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9.1-py3-none-any.whl#sha256=97ecff896cf8c8a3461730701532cb297638f594631d30e0a0e64bedacc771ce (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:14:33,259 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.9-py3-none-any.whl#sha256=aae7521fd8819d6dd3ae674c07816f449a70669bef1db6cdce2968c21ad1f7af (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:14:33,260 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.8-py3-none-any.whl#sha256=1ed005366d8f0154fa200db6e0eb56cc5ef33df2bbd2705d19c742e4283593c8 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.9) 2026-09-01T00:14:33,260 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.7-py3-none-any.whl#sha256=3b462a73021c5411e6b4491d07d5c4c009843435a2c9350ae5949fbf4a196ed9 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,261 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.5-py3-none-any.whl#sha256=c1292031153f79a22db4193ed91074a1c57ffaec3d9768215a455efd53ff5f02 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,261 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.4-py3-none-any.whl#sha256=1a6e6b514b470ad4c795439aa4cf9cb88b1360d915c7b3108ae5b47e3f7b36fc (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,262 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.3-py3-none-any.whl#sha256=7f4cb7cbd7ea20f2624f1315e69dfbc884cc187749c85760f9b4ec03e7efe491 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,262 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.2-py3-none-any.whl#sha256=a0bcaff492a09947d8a2b80400f224113b1e313da6a688084711130da18e1af7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,263 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.1-py3-none-any.whl#sha256=796615edf52f5673187a884a9d77c7d755fe95ca2d16fe77a1f042730eb957b3 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,264 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.4.0-py3-none-any.whl#sha256=1a863b5f478f2e66e921dbbf2e4dcda06a923021763f01b59c5b03bdd3af01c2 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2026-09-01T00:14:33,264 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.3.0-py3-none-any.whl#sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:14:33,265 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:14:33,265 Skipping link: No binaries permitted for lm-eval: https://archive1.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2026-09-01T00:14:33,266 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/ 2026-09-01T00:14:33,266 Skipping link: not a file: https://pypi.org/simple/lm-eval/ 2026-09-01T00:14:33,287 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates 2026-09-01T00:14:33,305 Collecting lm-eval==0.4.13.dev0 2026-09-01T00:14:33,307 Created temporary directory: /tmp/pip-unpack-d4rptmei 2026-09-01T00:14:33,541 Downloading lm_eval-0.4.13.dev0.tar.gz (3.5 MB) 2026-09-01T00:14:56,482 Added lm-eval==0.4.13.dev0 from https://files.pythonhosted.org/packages/6d/6d/e8bae20c63575c7d8939ebb0e6f22b9dc287f42a9d0f0a39523a186121ca/lm_eval-0.4.13.dev0.tar.gz to build tracker '/tmp/pip-build-tracker-6udn2v18' 2026-09-01T00:14:56,491 Created temporary directory: /tmp/pip-build-env-sbdzba18 2026-09-01T00:14:56,496 Installing build dependencies: started 2026-09-01T00:14:56,497 Running command pip subprocess to install build dependencies 2026-09-01T00:14:57,747 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-09-01T00:14:58,236 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-09-01T00:14:58,261 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-09-01T00:15:00,063 Collecting setuptools>=64.0 2026-09-01T00:15:00,064 Obtaining dependency information for setuptools>=64.0 from https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl.metadata 2026-09-01T00:15:00,078 Using cached https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl.metadata (6.6 kB) 2026-09-01T00:15:00,313 Using cached https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl (818 kB) 2026-09-01T00:15:00,400 Using cached https://www.piwheels.org/simple/setuptools/setuptools-84.0.0-py3-none-any.whl (818 kB) 2026-09-01T00:15:03,129 Installing collected packages: setuptools 2026-09-01T00:15:05,342 Successfully installed setuptools-84.0.0 2026-09-01T00:15:05,610 Installing build dependencies: finished with status 'done' 2026-09-01T00:15:05,616 Getting requirements to build wheel: started 2026-09-01T00:15:05,617 Running command Getting requirements to build wheel 2026-09-01T00:15:06,871 /tmp/pip-build-env-sbdzba18/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-09-01T00:15:06,871 !! 2026-09-01T00:15:06,872 ******************************************************************************** 2026-09-01T00:15:06,873 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-09-01T00:15:06,874 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-09-01T00:15:06,875 or your builds will no longer be supported. 2026-09-01T00:15:06,876 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-09-01T00:15:06,876 ******************************************************************************** 2026-09-01T00:15:06,877 !! 2026-09-01T00:15:06,877 corresp(dist, value, root_dir) 2026-09-01T00:15:06,970 running egg_info 2026-09-01T00:15:06,977 writing lm_eval.egg-info/PKG-INFO 2026-09-01T00:15:07,001 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2026-09-01T00:15:07,003 writing entry points to lm_eval.egg-info/entry_points.txt 2026-09-01T00:15:07,016 writing requirements to lm_eval.egg-info/requires.txt 2026-09-01T00:15:07,018 writing top-level names to lm_eval.egg-info/top_level.txt 2026-09-01T00:15:10,368 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:11,153 reading manifest template 'MANIFEST.in' 2026-09-01T00:15:11,155 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-09-01T00:15:11,156 adding license file 'LICENSE.md' 2026-09-01T00:15:12,020 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:12,157 Getting requirements to build wheel: finished with status 'done' 2026-09-01T00:15:12,161 Created temporary directory: /tmp/pip-modern-metadata-fh6qlbtt 2026-09-01T00:15:12,164 Preparing metadata (pyproject.toml): started 2026-09-01T00:15:12,165 Running command Preparing metadata (pyproject.toml) 2026-09-01T00:15:13,174 /tmp/pip-build-env-sbdzba18/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-09-01T00:15:13,174 !! 2026-09-01T00:15:13,176 ******************************************************************************** 2026-09-01T00:15:13,176 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-09-01T00:15:13,178 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-09-01T00:15:13,179 or your builds will no longer be supported. 2026-09-01T00:15:13,180 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-09-01T00:15:13,181 ******************************************************************************** 2026-09-01T00:15:13,183 !! 2026-09-01T00:15:13,183 corresp(dist, value, root_dir) 2026-09-01T00:15:13,302 running dist_info 2026-09-01T00:15:13,315 creating /tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info 2026-09-01T00:15:13,316 writing /tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/PKG-INFO 2026-09-01T00:15:13,346 writing dependency_links to /tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/dependency_links.txt 2026-09-01T00:15:13,348 writing entry points to /tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/entry_points.txt 2026-09-01T00:15:13,361 writing requirements to /tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/requires.txt 2026-09-01T00:15:13,364 writing top-level names to /tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/top_level.txt 2026-09-01T00:15:13,365 writing manifest file '/tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:19,223 reading manifest file '/tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:19,225 reading manifest template 'MANIFEST.in' 2026-09-01T00:15:19,226 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-09-01T00:15:19,227 adding license file 'LICENSE.md' 2026-09-01T00:15:19,764 writing manifest file '/tmp/pip-modern-metadata-fh6qlbtt/lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:19,788 creating '/tmp/pip-modern-metadata-fh6qlbtt/lm_eval-0.4.13.dev0.dist-info' 2026-09-01T00:15:19,936 Preparing metadata (pyproject.toml): finished with status 'done' 2026-09-01T00:15:19,946 Source in /tmp/pip-wheel-149vc3qs/lm-eval_5c8e2ec0d0db4f6cbe7fed4bd82e2ce2 has version 0.4.13.dev0, which satisfies requirement lm-eval==0.4.13.dev0 from https://files.pythonhosted.org/packages/6d/6d/e8bae20c63575c7d8939ebb0e6f22b9dc287f42a9d0f0a39523a186121ca/lm_eval-0.4.13.dev0.tar.gz 2026-09-01T00:15:19,947 Removed lm-eval==0.4.13.dev0 from https://files.pythonhosted.org/packages/6d/6d/e8bae20c63575c7d8939ebb0e6f22b9dc287f42a9d0f0a39523a186121ca/lm_eval-0.4.13.dev0.tar.gz from build tracker '/tmp/pip-build-tracker-6udn2v18' 2026-09-01T00:15:19,962 Created temporary directory: /tmp/pip-unpack-b5y3fqgy 2026-09-01T00:15:19,962 Building wheels for collected packages: lm-eval 2026-09-01T00:15:19,967 Created temporary directory: /tmp/pip-wheel-21juk1cj 2026-09-01T00:15:19,968 Destination directory: /tmp/pip-wheel-21juk1cj 2026-09-01T00:15:19,970 Building wheel for lm-eval (pyproject.toml): started 2026-09-01T00:15:19,971 Running command Building wheel for lm-eval (pyproject.toml) 2026-09-01T00:15:20,979 /tmp/pip-build-env-sbdzba18/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-09-01T00:15:20,979 !! 2026-09-01T00:15:20,980 ******************************************************************************** 2026-09-01T00:15:20,981 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-09-01T00:15:20,982 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-09-01T00:15:20,983 or your builds will no longer be supported. 2026-09-01T00:15:20,984 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-09-01T00:15:20,984 ******************************************************************************** 2026-09-01T00:15:20,986 !! 2026-09-01T00:15:20,986 corresp(dist, value, root_dir) 2026-09-01T00:15:21,070 running bdist_wheel 2026-09-01T00:15:21,088 running build 2026-09-01T00:15:21,089 running build_py 2026-09-01T00:15:21,095 creating build/lib/lm_eval 2026-09-01T00:15:21,097 copying lm_eval/evaluator.py -> build/lib/lm_eval 2026-09-01T00:15:21,100 copying lm_eval/__init__.py -> build/lib/lm_eval 2026-09-01T00:15:21,102 copying lm_eval/evaluator_utils.py -> build/lib/lm_eval 2026-09-01T00:15:21,105 copying lm_eval/utils.py -> build/lib/lm_eval 2026-09-01T00:15:21,108 copying lm_eval/result_schema.py -> build/lib/lm_eval 2026-09-01T00:15:21,110 copying lm_eval/__main__.py -> build/lib/lm_eval 2026-09-01T00:15:21,112 copying lm_eval/defaults.py -> build/lib/lm_eval 2026-09-01T00:15:21,115 creating build/lib/lm_eval/caching 2026-09-01T00:15:21,116 copying lm_eval/caching/__init__.py -> build/lib/lm_eval/caching 2026-09-01T00:15:21,117 copying lm_eval/caching/cache.py -> build/lib/lm_eval/caching 2026-09-01T00:15:21,120 creating build/lib/lm_eval/filters 2026-09-01T00:15:21,121 copying lm_eval/filters/selection.py -> build/lib/lm_eval/filters 2026-09-01T00:15:21,124 copying lm_eval/filters/custom.py -> build/lib/lm_eval/filters 2026-09-01T00:15:21,125 copying lm_eval/filters/__init__.py -> build/lib/lm_eval/filters 2026-09-01T00:15:21,127 copying lm_eval/filters/extraction.py -> build/lib/lm_eval/filters 2026-09-01T00:15:21,130 copying lm_eval/filters/transformation.py -> build/lib/lm_eval/filters 2026-09-01T00:15:21,132 copying lm_eval/filters/decontamination.py -> build/lib/lm_eval/filters 2026-09-01T00:15:21,134 creating build/lib/lm_eval/config 2026-09-01T00:15:21,135 copying lm_eval/config/__init__.py -> build/lib/lm_eval/config 2026-09-01T00:15:21,137 copying lm_eval/config/evaluate_config.py -> build/lib/lm_eval/config 2026-09-01T00:15:21,140 copying lm_eval/config/task.py -> build/lib/lm_eval/config 2026-09-01T00:15:21,142 copying lm_eval/config/group.py -> build/lib/lm_eval/config 2026-09-01T00:15:21,146 creating build/lib/lm_eval/models 2026-09-01T00:15:21,147 copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,149 copying lm_eval/models/trtllm_causallms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,152 copying lm_eval/models/nemo_lm.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,154 copying lm_eval/models/hf_audiolm.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,157 copying lm_eval/models/gguf.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,159 copying lm_eval/models/onnxruntime_genai.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,161 copying lm_eval/models/optimum_lm.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,163 copying lm_eval/models/api_models.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,166 copying lm_eval/models/onnxruntime_ort.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,168 copying lm_eval/models/litellm_llms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,170 copying lm_eval/models/vllm_vlms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,173 copying lm_eval/models/hf_vlms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,176 copying lm_eval/models/megatron_lm.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,179 copying lm_eval/models/sglang_generate_API.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,181 copying lm_eval/models/mamba_lm.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,183 copying lm_eval/models/__init__.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,185 copying lm_eval/models/mistral3.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,187 copying lm_eval/models/utils.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,190 copying lm_eval/models/sglang_causallms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,193 copying lm_eval/models/optimum_ipex.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,195 copying lm_eval/models/utils_hf.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,197 copying lm_eval/models/anthropic_llms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,200 copying lm_eval/models/neuron_optimum.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,203 copying lm_eval/models/winml.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,205 copying lm_eval/models/vllm_causallms.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,208 copying lm_eval/models/_onnx_base.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,210 copying lm_eval/models/openai_completions.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,213 copying lm_eval/models/optimum_habana.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,215 copying lm_eval/models/huggingface.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,219 copying lm_eval/models/dummy.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,221 copying lm_eval/models/hf_steered.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,223 copying lm_eval/models/ibm_watsonx_ai.py -> build/lib/lm_eval/models 2026-09-01T00:15:21,227 creating build/lib/lm_eval/prompts 2026-09-01T00:15:21,228 copying lm_eval/prompts/__init__.py -> build/lib/lm_eval/prompts 2026-09-01T00:15:21,231 creating build/lib/lm_eval/loggers 2026-09-01T00:15:21,232 copying lm_eval/loggers/trackio_logger.py -> build/lib/lm_eval/loggers 2026-09-01T00:15:21,235 copying lm_eval/loggers/__init__.py -> build/lib/lm_eval/loggers 2026-09-01T00:15:21,237 copying lm_eval/loggers/utils.py -> build/lib/lm_eval/loggers 2026-09-01T00:15:21,240 copying lm_eval/loggers/wandb_logger.py -> build/lib/lm_eval/loggers 2026-09-01T00:15:21,242 copying lm_eval/loggers/evaluation_tracker.py -> build/lib/lm_eval/loggers 2026-09-01T00:15:21,246 creating build/lib/lm_eval/tasks 2026-09-01T00:15:21,247 copying lm_eval/tasks/manager.py -> build/lib/lm_eval/tasks 2026-09-01T00:15:21,249 copying lm_eval/tasks/_yaml_loader.py -> build/lib/lm_eval/tasks 2026-09-01T00:15:21,252 copying lm_eval/tasks/_index.py -> build/lib/lm_eval/tasks 2026-09-01T00:15:21,254 copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks 2026-09-01T00:15:21,256 copying lm_eval/tasks/_factory.py -> build/lib/lm_eval/tasks 2026-09-01T00:15:21,259 creating build/lib/lm_eval/_cli 2026-09-01T00:15:21,260 copying lm_eval/_cli/ls.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,262 copying lm_eval/_cli/harness.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,264 copying lm_eval/_cli/__init__.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,266 copying lm_eval/_cli/utils.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,269 copying lm_eval/_cli/validate.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,271 copying lm_eval/_cli/subcommand.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,273 copying lm_eval/_cli/run.py -> build/lib/lm_eval/_cli 2026-09-01T00:15:21,276 creating build/lib/lm_eval/decontamination 2026-09-01T00:15:21,277 copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination 2026-09-01T00:15:21,279 copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination 2026-09-01T00:15:21,282 copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination 2026-09-01T00:15:21,283 copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination 2026-09-01T00:15:21,286 creating build/lib/lm_eval/api 2026-09-01T00:15:21,287 copying lm_eval/api/model.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,290 copying lm_eval/api/instance.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,292 copying lm_eval/api/metrics.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,294 copying lm_eval/api/filter.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,296 copying lm_eval/api/registry.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,299 copying lm_eval/api/__init__.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,300 copying lm_eval/api/utils.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,302 copying lm_eval/api/samplers.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,304 copying lm_eval/api/task.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,308 copying lm_eval/api/group.py -> build/lib/lm_eval/api 2026-09-01T00:15:21,311 creating build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:21,312 copying lm_eval/tasks/hendrycks_ethics/utils.py -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:21,315 creating build/lib/lm_eval/tasks/mbpp 2026-09-01T00:15:21,316 copying lm_eval/tasks/mbpp/utils.py -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:15:21,318 creating build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:15:21,319 copying lm_eval/tasks/truthfulqa/utils.py -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:15:21,322 creating build/lib/lm_eval/tasks/c4 2026-09-01T00:15:21,323 copying lm_eval/tasks/c4/preprocess_c4.py -> build/lib/lm_eval/tasks/c4 2026-09-01T00:15:21,328 creating build/lib/lm_eval/tasks/lingoly 2026-09-01T00:15:21,329 copying lm_eval/tasks/lingoly/utils.py -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:15:21,331 copying lm_eval/tasks/lingoly/script.py -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:15:21,333 creating build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:21,334 copying lm_eval/tasks/mmlu-pro-plus/utils.py -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:21,337 creating build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:15:21,338 copying lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:15:21,340 copying lm_eval/tasks/mimic_repsum/utils.py -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:15:21,343 creating build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:21,344 copying lm_eval/tasks/egymmlu/utils.py -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:21,346 copying lm_eval/tasks/egymmlu/_generate_configs.py -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:21,348 creating build/lib/lm_eval/tasks/aime 2026-09-01T00:15:21,349 copying lm_eval/tasks/aime/utils.py -> build/lib/lm_eval/tasks/aime 2026-09-01T00:15:21,352 creating build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:15:21,353 copying lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:15:21,355 creating build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:15:21,356 copying lm_eval/tasks/wmt2016/metrics.py -> build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:15:21,359 creating build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:21,360 copying lm_eval/tasks/xcopa/utils.py -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:21,362 creating build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:21,363 copying lm_eval/tasks/eus_exams/utils.py -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:21,366 copying lm_eval/tasks/eus_exams/configs.py -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:21,368 creating build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:21,369 copying lm_eval/tasks/cruxeval/utils.py -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:21,372 creating build/lib/lm_eval/tasks/translation 2026-09-01T00:15:21,373 copying lm_eval/tasks/translation/utils.py -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:21,376 creating build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:21,377 copying lm_eval/tasks/galician_bench/utils.py -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:21,380 creating build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:21,381 copying lm_eval/tasks/greekmmlu/utils.py -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:21,383 copying lm_eval/tasks/greekmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:21,386 creating build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:15:21,387 copying lm_eval/tasks/openai-mmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:15:21,390 creating build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,391 copying lm_eval/tasks/ruler/vt_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,394 copying lm_eval/tasks/ruler/prepare_niah.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,397 copying lm_eval/tasks/ruler/essays.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,399 copying lm_eval/tasks/ruler/qa_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,402 copying lm_eval/tasks/ruler/cwe_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,405 copying lm_eval/tasks/ruler/niah_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,408 copying lm_eval/tasks/ruler/common_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,410 copying lm_eval/tasks/ruler/fwe_utils.py -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:21,414 creating build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:21,416 copying lm_eval/tasks/cabbq/utils.py -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:21,420 creating build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:15:21,421 copying lm_eval/tasks/eq_bench/utils.py -> build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:15:21,424 creating build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:21,425 copying lm_eval/tasks/catalan_bench/utils.py -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:21,429 creating build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:21,430 copying lm_eval/tasks/babilong/common_utils.py -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:21,434 creating build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:21,436 copying lm_eval/tasks/csatqa/utils.py -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:21,439 copying lm_eval/tasks/csatqa/_generate_configs.py -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:21,442 creating build/lib/lm_eval/tasks/mgsm 2026-09-01T00:15:21,443 copying lm_eval/tasks/mgsm/utils.py -> build/lib/lm_eval/tasks/mgsm 2026-09-01T00:15:21,446 creating build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:21,448 copying lm_eval/tasks/meddialog/utils_perplexity.py -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:21,450 copying lm_eval/tasks/meddialog/utils.py -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:21,453 creating build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:21,454 copying lm_eval/tasks/belebele/_generate_configs.py -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:21,457 creating build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:21,458 copying lm_eval/tasks/paws-x/_generate_config.py -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:21,461 copying lm_eval/tasks/paws-x/utils.py -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:21,464 creating build/lib/lm_eval/tasks/copal_id 2026-09-01T00:15:21,465 copying lm_eval/tasks/copal_id/utils.py -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:15:21,468 creating build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:15:21,469 copying lm_eval/tasks/afrimgsm/utils.py -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:15:21,472 copying lm_eval/tasks/afrimgsm/gen_utils.py -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:15:21,475 creating build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:21,476 copying lm_eval/tasks/mlqa/utils.py -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:21,479 copying lm_eval/tasks/mlqa/generate_tasks.py -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:21,482 creating build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:21,483 copying lm_eval/tasks/pisa/utils.py -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:21,487 creating build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:21,488 copying lm_eval/tasks/winogender/utils.py -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:21,491 creating build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:15:21,492 copying lm_eval/tasks/med_prescriptions/utils.py -> build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:15:21,499 creating build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:15:21,500 copying lm_eval/tasks/groundcocoa/utils.py -> build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:15:21,503 creating build/lib/lm_eval/tasks/fda 2026-09-01T00:15:21,504 copying lm_eval/tasks/fda/task.py -> build/lib/lm_eval/tasks/fda 2026-09-01T00:15:21,508 creating build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:21,509 copying lm_eval/tasks/xquad/utils.py -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:21,511 creating build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:15:21,512 copying lm_eval/tasks/afrixnli/utils.py -> build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:15:21,515 copying lm_eval/tasks/afrixnli/gen_utils.py -> build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:15:21,517 creating build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:21,518 copying lm_eval/tasks/arab_culture/utils_mcq.py -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:21,520 copying lm_eval/tasks/arab_culture/prompts.py -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:21,523 copying lm_eval/tasks/arab_culture/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:21,525 creating build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:15:21,526 copying lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:15:21,529 creating build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:21,530 copying lm_eval/tasks/agieval/utils.py -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:21,534 creating build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:15:21,535 copying lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:15:21,537 copying lm_eval/tasks/mts_dialog/utils.py -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:15:21,540 creating build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:21,541 copying lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:21,544 creating build/lib/lm_eval/tasks/toksuite 2026-09-01T00:15:21,545 copying lm_eval/tasks/toksuite/utils.py -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:15:21,549 creating build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:21,549 copying lm_eval/tasks/evalita_llm/metrics.py -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:21,552 copying lm_eval/tasks/evalita_llm/utils.py -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:21,554 copying lm_eval/tasks/evalita_llm/sum_utils.py -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:21,557 creating build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:21,558 copying lm_eval/tasks/infinitebench/utils.py -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:21,561 creating build/lib/lm_eval/tasks/wsc273 2026-09-01T00:15:21,562 copying lm_eval/tasks/wsc273/utils.py -> build/lib/lm_eval/tasks/wsc273 2026-09-01T00:15:21,564 creating build/lib/lm_eval/tasks/logiqa 2026-09-01T00:15:21,565 copying lm_eval/tasks/logiqa/utils_logiqa.py -> build/lib/lm_eval/tasks/logiqa 2026-09-01T00:15:21,568 creating build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:15:21,569 copying lm_eval/tasks/histoires_morales/utils.py -> build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:15:21,571 creating build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:15:21,572 copying lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:15:21,574 creating build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:21,575 copying lm_eval/tasks/truthfulqa-multi/utils.py -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:21,579 creating build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:21,580 copying lm_eval/tasks/scrolls/task.py -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:21,583 creating build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:21,584 copying lm_eval/tasks/hendrycks_math/utils.py -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:21,586 creating build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:15:21,587 copying lm_eval/tasks/mmlu_prox/lang_libs.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:15:21,590 copying lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:15:21,593 copying lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:15:21,595 creating build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:21,597 copying lm_eval/tasks/xnli/utils.py -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:21,600 creating build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:21,601 copying lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:21,603 copying lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:21,605 copying lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:21,607 copying lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:21,609 creating build/lib/lm_eval/tasks/meqsum 2026-09-01T00:15:21,610 copying lm_eval/tasks/meqsum/utils.py -> build/lib/lm_eval/tasks/meqsum 2026-09-01T00:15:21,613 creating build/lib/lm_eval/tasks/glianorex 2026-09-01T00:15:21,614 copying lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:15:21,616 creating build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:15:21,617 copying lm_eval/tasks/egyhellaswag/utils.py -> build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:15:21,620 creating build/lib/lm_eval/tasks/swde 2026-09-01T00:15:21,621 copying lm_eval/tasks/swde/task.py -> build/lib/lm_eval/tasks/swde 2026-09-01T00:15:21,624 creating build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:15:21,625 copying lm_eval/tasks/cnn_dailymail/utils.py -> build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:15:21,627 creating build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:21,629 copying lm_eval/tasks/aclue/_generate_configs.py -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:21,632 creating build/lib/lm_eval/tasks/chartqa 2026-09-01T00:15:21,633 copying lm_eval/tasks/chartqa/utils.py -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:15:21,635 creating build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:15:21,636 copying lm_eval/tasks/jsonschema_bench/metrics.py -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:15:21,639 creating build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:15:21,640 copying lm_eval/tasks/physics_gre/utils.py -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:15:21,643 creating build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:21,644 copying lm_eval/tasks/slr_bench/lm_eval_slr_bench.py -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:21,647 creating build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:15:21,648 copying lm_eval/tasks/squad_completion/task.py -> build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:15:21,651 creating build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:21,652 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:21,654 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:21,656 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:21,658 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:21,660 creating build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:21,661 copying lm_eval/tasks/basque_bench/utils.py -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:21,664 creating build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:21,665 copying lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:21,667 copying lm_eval/tasks/french_bench/utils.py -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:21,670 creating build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:21,670 copying lm_eval/tasks/darijammlu/utils.py -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:21,672 copying lm_eval/tasks/darijammlu/_generate_configs.py -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:21,675 creating build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:21,676 copying lm_eval/tasks/kormedmcqa/utils.py -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:21,678 creating build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:21,680 copying lm_eval/tasks/cmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:21,683 creating build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:21,684 copying lm_eval/tasks/mmmu/utils.py -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:21,687 creating build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:15:21,688 copying lm_eval/tasks/eus_trivia/utils.py -> build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:15:21,691 creating build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:21,691 copying lm_eval/tasks/longbench/metrics.py -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:21,694 copying lm_eval/tasks/longbench/_generate_config.py -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:21,696 copying lm_eval/tasks/longbench/utils.py -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:21,699 creating build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:21,700 copying lm_eval/tasks/kobest/utils.py -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:21,702 creating build/lib/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:15:21,703 copying lm_eval/tasks/realtoxicityprompts/metric.py -> build/lib/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:15:21,706 creating build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:21,707 copying lm_eval/tasks/portuguese_bench/assin2_utils.py -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:21,710 creating build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:21,711 copying lm_eval/tasks/longproc/metrics.py -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:21,713 copying lm_eval/tasks/longproc/utils.py -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:21,716 creating build/lib/lm_eval/tasks/mathqa 2026-09-01T00:15:21,717 copying lm_eval/tasks/mathqa/utils.py -> build/lib/lm_eval/tasks/mathqa 2026-09-01T00:15:21,720 creating build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:21,721 copying lm_eval/tasks/crows_pairs/utils.py -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:21,724 creating build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:15:21,725 copying lm_eval/tasks/darijahellaswag/utils.py -> build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:15:21,727 creating build/lib/lm_eval/tasks/bbh 2026-09-01T00:15:21,728 copying lm_eval/tasks/bbh/_generate_configs.py -> build/lib/lm_eval/tasks/bbh 2026-09-01T00:15:21,731 creating build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:15:21,732 copying lm_eval/tasks/med_text_classification/utils.py -> build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:15:21,734 creating build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:15:21,735 copying lm_eval/tasks/discrim_eval/utils.py -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:15:21,738 creating build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:21,739 copying lm_eval/tasks/arabicmmlu/utils.py -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:21,741 copying lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:21,744 creating build/lib/lm_eval/tasks/toxigen 2026-09-01T00:15:21,745 copying lm_eval/tasks/toxigen/utils.py -> build/lib/lm_eval/tasks/toxigen 2026-09-01T00:15:21,748 creating build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:15:21,748 copying lm_eval/tasks/eus_reading/utils.py -> build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:15:21,751 creating build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:21,752 copying lm_eval/tasks/ceval/_generate_configs.py -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:21,757 creating build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:15:21,758 copying lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:15:21,760 creating build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:21,761 copying lm_eval/tasks/basqueglue/utils.py -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:21,763 creating build/lib/lm_eval/tasks/coqa 2026-09-01T00:15:21,764 copying lm_eval/tasks/coqa/utils.py -> build/lib/lm_eval/tasks/coqa 2026-09-01T00:15:21,767 creating build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:15:21,768 copying lm_eval/tasks/afrimmlu/utils.py -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:15:21,770 copying lm_eval/tasks/afrimmlu/gen_utils.py -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:15:21,772 creating build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:21,773 copying lm_eval/tasks/humaneval/utils.py -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:21,776 creating build/lib/lm_eval/tasks/score 2026-09-01T00:15:21,777 copying lm_eval/tasks/score/utils.py -> build/lib/lm_eval/tasks/score 2026-09-01T00:15:21,780 copying lm_eval/tasks/score/non_greedy_summarizer.py -> build/lib/lm_eval/tasks/score 2026-09-01T00:15:21,782 creating build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:21,783 copying lm_eval/tasks/spanish_bench/utils.py -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:21,786 creating build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:21,787 copying lm_eval/tasks/careqa/utils_perplexity.py -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:21,789 copying lm_eval/tasks/careqa/utils.py -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:21,791 copying lm_eval/tasks/careqa/utils_open.py -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:21,794 creating build/lib/lm_eval/tasks/drop 2026-09-01T00:15:21,795 copying lm_eval/tasks/drop/utils.py -> build/lib/lm_eval/tasks/drop 2026-09-01T00:15:21,799 creating build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:21,800 copying lm_eval/tasks/indicparam/utils.py -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:21,802 creating build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:21,803 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_utils.py -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:21,806 creating build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:15:21,807 copying lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:15:21,809 copying lm_eval/tasks/mediqa_qa2019/utils.py -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:15:21,811 creating build/lib/lm_eval/tasks/webqs 2026-09-01T00:15:21,812 copying lm_eval/tasks/webqs/utils.py -> build/lib/lm_eval/tasks/webqs 2026-09-01T00:15:21,814 creating build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:15:21,822 copying lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:15:21,825 creating build/lib/lm_eval/tasks/mmlusr 2026-09-01T00:15:21,826 copying lm_eval/tasks/mmlusr/config.py -> build/lib/lm_eval/tasks/mmlusr 2026-09-01T00:15:21,829 creating build/lib/lm_eval/tasks/ifeval 2026-09-01T00:15:21,830 copying lm_eval/tasks/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:15:21,834 copying lm_eval/tasks/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:15:21,836 copying lm_eval/tasks/ifeval/instructions.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:15:21,839 copying lm_eval/tasks/ifeval/utils.py -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:15:21,843 creating build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:15:21,844 copying lm_eval/tasks/humaneval_infilling/utils.py -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:15:21,847 creating build/lib/lm_eval/tasks/unitxt 2026-09-01T00:15:21,848 copying lm_eval/tasks/unitxt/task.py -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:15:21,852 creating build/lib/lm_eval/tasks/mutual 2026-09-01T00:15:21,853 copying lm_eval/tasks/mutual/utils.py -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:15:21,857 creating build/lib/lm_eval/tasks/bbq 2026-09-01T00:15:21,858 copying lm_eval/tasks/bbq/utils.py -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:15:21,861 creating build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:15:21,862 copying lm_eval/tasks/tydiqa/utils.py -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:15:21,866 creating build/lib/lm_eval/tasks/mmlu 2026-09-01T00:15:21,867 copying lm_eval/tasks/mmlu/_generate_configs.py -> build/lib/lm_eval/tasks/mmlu 2026-09-01T00:15:21,870 creating build/lib/lm_eval/tasks/wikitext 2026-09-01T00:15:21,871 copying lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/lib/lm_eval/tasks/wikitext 2026-09-01T00:15:21,874 creating build/lib/lm_eval/tasks/medqa 2026-09-01T00:15:21,876 copying lm_eval/tasks/medqa/preprocess_medqa.py -> build/lib/lm_eval/tasks/medqa 2026-09-01T00:15:21,879 creating build/lib/lm_eval/tasks/medtext 2026-09-01T00:15:21,880 copying lm_eval/tasks/medtext/utils_perplexity.py -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:15:21,882 copying lm_eval/tasks/medtext/utils.py -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:15:21,885 creating build/lib/lm_eval/tasks/noticia 2026-09-01T00:15:21,887 copying lm_eval/tasks/noticia/utils.py -> build/lib/lm_eval/tasks/noticia 2026-09-01T00:15:21,889 creating build/lib/lm_eval/tasks/olaph 2026-09-01T00:15:21,891 copying lm_eval/tasks/olaph/utils_perplexity.py -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:15:21,893 copying lm_eval/tasks/olaph/utils.py -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:15:21,896 creating build/lib/lm_eval/tasks/race 2026-09-01T00:15:21,897 copying lm_eval/tasks/race/preprocess_race.py -> build/lib/lm_eval/tasks/race 2026-09-01T00:15:21,900 creating build/lib/lm_eval/tasks/metabench 2026-09-01T00:15:21,901 copying lm_eval/tasks/metabench/process_docs_permute.py -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:15:21,904 copying lm_eval/tasks/metabench/process_docs.py -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:15:21,907 creating build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:15:21,908 copying lm_eval/tasks/xwinograd/utils.py -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:15:21,911 creating build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:15:21,913 copying lm_eval/tasks/arab_culture_completion/prompts.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:15:21,915 copying lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:15:21,917 copying lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:15:21,920 creating build/lib/lm_eval/tasks/paloma 2026-09-01T00:15:21,921 copying lm_eval/tasks/paloma/paloma_utils.py -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:15:21,924 creating build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:15:21,925 copying lm_eval/tasks/graphwalks/utils.py -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:15:21,929 creating build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:15:21,930 copying lm_eval/tasks/moral_stories/utils.py -> build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:15:21,933 creating build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:15:21,935 copying lm_eval/tasks/putnam_axiom/utils.py -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:15:21,938 creating build/lib/lm_eval/tasks/common_voice 2026-09-01T00:15:21,939 copying lm_eval/tasks/common_voice/utils.py -> build/lib/lm_eval/tasks/common_voice 2026-09-01T00:15:21,942 creating build/lib/lm_eval/tasks/qasper 2026-09-01T00:15:21,944 copying lm_eval/tasks/qasper/metrics.py -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:15:21,946 copying lm_eval/tasks/qasper/utils.py -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:15:21,948 creating build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:15:21,950 copying lm_eval/tasks/hellaswag/utils.py -> build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:15:21,952 creating build/lib/lm_eval/tasks/esbbq 2026-09-01T00:15:21,954 copying lm_eval/tasks/esbbq/utils.py -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:15:21,957 creating build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:15:21,958 copying lm_eval/tasks/jfinqa/utils.py -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:15:21,961 copying lm_eval/tasks/jfinqa/test_jfinqa_utils.py -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:15:21,964 creating build/lib/lm_eval/tasks/bigbench 2026-09-01T00:15:21,965 copying lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:15:21,967 copying lm_eval/tasks/bigbench/utils.py -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:15:21,970 copying lm_eval/tasks/bigbench/generate_tasks.py -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:15:21,974 creating build/lib/lm_eval/tasks/blimp 2026-09-01T00:15:21,975 copying lm_eval/tasks/blimp/generate_configs.py -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:15:21,978 creating build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:15:21,980 copying lm_eval/tasks/nerel-bench/utils.py -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:15:21,984 creating build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:15:21,985 copying lm_eval/tasks/minerva_math/utils.py -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:15:21,989 creating build/lib/lm_eval/tasks/squadv2 2026-09-01T00:15:21,990 copying lm_eval/tasks/squadv2/task.py -> build/lib/lm_eval/tasks/squadv2 2026-09-01T00:15:21,993 creating build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:15:21,995 copying lm_eval/tasks/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:15:21,998 creating build/lib/lm_eval/tasks/medmcqa 2026-09-01T00:15:21,999 copying lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/lib/lm_eval/tasks/medmcqa 2026-09-01T00:15:22,003 creating build/lib/lm_eval/tasks/libra 2026-09-01T00:15:22,004 copying lm_eval/tasks/libra/utils.py -> build/lib/lm_eval/tasks/libra 2026-09-01T00:15:22,007 creating build/lib/lm_eval/tasks/winogrande 2026-09-01T00:15:22,008 copying lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/winogrande 2026-09-01T00:15:22,011 creating build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:15:22,013 copying lm_eval/tasks/arithmetic/utils.py -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:15:22,016 creating build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:22,018 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:22,022 creating build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:22,023 copying lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:22,028 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:15:22,030 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:15:22,032 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:15:22,034 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:15:22,036 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:15:22,038 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:15:22,040 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:15:22,042 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:15:22,044 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:22,046 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:22,049 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:15:22,050 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:15:22,053 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:15:22,054 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:15:22,057 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:22,058 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:22,061 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:15:22,062 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:15:22,064 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:22,065 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:22,068 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:15:22,069 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:15:22,071 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:15:22,072 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:15:22,074 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:15:22,075 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:15:22,078 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:15:22,079 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:15:22,081 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:15:22,082 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:15:22,085 creating build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:22,086 copying lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:22,092 creating build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:22,094 copying lm_eval/tasks/openai-mmmlu/default/utils.py -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:22,097 creating build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:22,099 copying lm_eval/tasks/tmlu/default/utils.py -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:22,101 copying lm_eval/tasks/tmlu/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:22,104 creating build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:15:22,105 copying lm_eval/tasks/eq_bench/multilingual/utils.py -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:15:22,108 creating build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:15:22,109 copying lm_eval/tasks/catalan_bench/cieacova/utils.py -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:15:22,112 creating build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:15:22,113 copying lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py -> build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:15:22,116 creating build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:22,117 copying lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:22,130 creating build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:15:22,132 copying lm_eval/tasks/click/click_lang/utils.py -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:15:22,135 creating build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:22,136 copying lm_eval/tasks/click/click_cul/utils.py -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:22,139 creating build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:22,140 copying lm_eval/tasks/hrm8k/en/utils.py -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:22,144 creating build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:22,145 copying lm_eval/tasks/hrm8k/default/utils.py -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:22,148 creating build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:15:22,150 copying lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:15:22,152 creating build/lib/lm_eval/tasks/noreval/norsumm 2026-09-01T00:15:22,153 copying lm_eval/tasks/noreval/norsumm/utils.py -> build/lib/lm_eval/tasks/noreval/norsumm 2026-09-01T00:15:22,158 creating build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:22,159 copying lm_eval/tasks/noreval/ask_gec/errant.py -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:22,162 creating build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:22,163 copying lm_eval/tasks/noreval/norquad/utils.py -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:22,166 creating build/lib/lm_eval/tasks/noreval/norec 2026-09-01T00:15:22,167 copying lm_eval/tasks/noreval/norec/utils.py -> build/lib/lm_eval/tasks/noreval/norec 2026-09-01T00:15:22,169 creating build/lib/lm_eval/tasks/noreval/noridiom 2026-09-01T00:15:22,170 copying lm_eval/tasks/noreval/noridiom/utils.py -> build/lib/lm_eval/tasks/noreval/noridiom 2026-09-01T00:15:22,175 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:15:22,177 copying lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:15:22,181 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:22,183 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:22,185 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:22,186 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:22,190 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:22,192 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:22,195 creating build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:22,196 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:22,201 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:22,203 copying lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:22,206 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:22,207 copying lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:22,210 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:22,212 copying lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:22,215 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:22,216 copying lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:22,219 creating build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:22,221 copying lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:22,224 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:22,226 copying lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:22,229 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:22,230 copying lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:22,233 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:22,235 copying lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:22,238 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:22,239 copying lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:22,243 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:22,244 copying lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:22,247 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:22,248 copying lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:22,251 creating build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:22,252 copying lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:22,255 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:22,257 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:22,260 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:22,261 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:22,264 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:22,265 copying lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:22,272 creating build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:22,274 copying lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:22,277 copying lm_eval/tasks/code_x_glue/code-text/utils.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:22,280 creating build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:15:22,282 copying lm_eval/tasks/gpqa/zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:15:22,284 copying lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:15:22,287 creating build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:15:22,288 copying lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:15:22,291 copying lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:15:22,294 creating build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:15:22,295 copying lm_eval/tasks/gpqa/n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:15:22,297 copying lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:15:22,300 creating build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:15:22,301 copying lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:15:22,304 copying lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:15:22,306 creating build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:15:22,307 copying lm_eval/tasks/gpqa/generative/utils.py -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:15:22,309 copying lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:15:22,312 creating build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:22,313 copying lm_eval/tasks/mmlu_prox/id/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:22,315 creating build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:22,316 copying lm_eval/tasks/mmlu_prox/ar/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:22,319 creating build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:22,320 copying lm_eval/tasks/mmlu_prox/yo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:22,322 creating build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:22,323 copying lm_eval/tasks/mmlu_prox/hi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:22,326 creating build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:22,327 copying lm_eval/tasks/mmlu_prox/de/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:22,329 creating build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:22,330 copying lm_eval/tasks/mmlu_prox/ja/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:22,332 creating build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:22,333 copying lm_eval/tasks/mmlu_prox/cs/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:22,336 creating build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:22,337 copying lm_eval/tasks/mmlu_prox/mr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:22,339 creating build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:22,340 copying lm_eval/tasks/mmlu_prox/es/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:22,343 creating build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:22,344 copying lm_eval/tasks/mmlu_prox/af/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:22,346 creating build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:22,347 copying lm_eval/tasks/mmlu_prox/vi/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:22,349 creating build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:22,350 copying lm_eval/tasks/mmlu_prox/wo/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:22,353 creating build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:22,354 copying lm_eval/tasks/mmlu_prox/zh/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:22,356 creating build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:22,357 copying lm_eval/tasks/mmlu_prox/pt/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:22,360 creating build/lib/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:15:22,361 copying lm_eval/tasks/mmlu_prox/template/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:15:22,363 creating build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:22,364 copying lm_eval/tasks/mmlu_prox/uk/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:22,367 creating build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:22,368 copying lm_eval/tasks/mmlu_prox/te/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:22,370 creating build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:22,371 copying lm_eval/tasks/mmlu_prox/fr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:22,374 creating build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:22,375 copying lm_eval/tasks/mmlu_prox/en/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:22,377 creating build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:22,378 copying lm_eval/tasks/mmlu_prox/zu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:22,381 creating build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:22,382 copying lm_eval/tasks/mmlu_prox/bn/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:22,384 creating build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:22,386 copying lm_eval/tasks/mmlu_prox/sw/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:22,388 creating build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:22,389 copying lm_eval/tasks/mmlu_prox/hu/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:22,392 creating build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:22,393 copying lm_eval/tasks/mmlu_prox/ur/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:22,396 creating build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:22,397 copying lm_eval/tasks/mmlu_prox/sr/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:22,399 creating build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:22,400 copying lm_eval/tasks/mmlu_prox/ko/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:22,402 creating build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:22,403 copying lm_eval/tasks/mmlu_prox/ne/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:22,406 creating build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:22,406 copying lm_eval/tasks/mmlu_prox/it/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:22,409 creating build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:22,410 copying lm_eval/tasks/mmlu_prox/th/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:22,413 creating build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:22,413 copying lm_eval/tasks/mmlu_prox/ru/utils.py -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:22,419 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:22,420 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:22,423 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:15:22,424 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:15:22,426 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:22,428 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:22,430 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:22,431 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:22,434 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:15:22,435 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:15:22,437 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:15:22,438 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:15:22,441 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:15:22,442 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:15:22,444 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:15:22,446 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:15:22,448 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:15:22,449 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:15:22,452 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:15:22,453 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:15:22,455 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:15:22,456 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:15:22,458 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:15:22,459 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:15:22,461 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:15:22,462 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:15:22,465 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:15:22,466 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:15:22,468 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:15:22,469 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:15:22,472 creating build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:22,474 copying lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:22,477 creating build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:22,478 copying lm_eval/tasks/global_mmlu/full/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:22,480 creating build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:22,481 copying lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:22,484 creating build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:22,485 copying lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:22,488 creating build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:22,489 copying lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:22,491 creating build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:22,492 copying lm_eval/tasks/global_mmlu/full/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:22,495 creating build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:22,496 copying lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:22,499 creating build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:22,500 copying lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:22,502 creating build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:22,503 copying lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:22,506 creating build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:22,507 copying lm_eval/tasks/global_mmlu/full/am/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:22,509 creating build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:22,510 copying lm_eval/tasks/global_mmlu/full/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:22,513 creating build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:22,514 copying lm_eval/tasks/global_mmlu/full/el/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:22,517 creating build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:22,517 copying lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:22,520 creating build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:22,521 copying lm_eval/tasks/global_mmlu/full/so/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:22,524 creating build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:22,524 copying lm_eval/tasks/global_mmlu/full/si/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:22,527 creating build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:22,528 copying lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:22,531 creating build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:22,532 copying lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:22,534 creating build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:22,535 copying lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:22,538 creating build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:22,539 copying lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:22,542 creating build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:22,543 copying lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:22,545 creating build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:22,546 copying lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:22,549 creating build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:22,550 copying lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:22,553 creating build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:22,554 copying lm_eval/tasks/global_mmlu/full/he/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:22,557 creating build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:22,558 copying lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:22,560 creating build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:22,561 copying lm_eval/tasks/global_mmlu/full/te/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:22,564 creating build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:22,565 copying lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:22,568 creating build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:22,569 copying lm_eval/tasks/global_mmlu/full/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:22,572 creating build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:22,573 copying lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:22,575 creating build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:22,576 copying lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:22,579 creating build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:22,580 copying lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:22,582 creating build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:22,584 copying lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:22,586 creating build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:22,587 copying lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:22,589 creating build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:22,590 copying lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:22,593 creating build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:22,594 copying lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:22,596 creating build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:22,597 copying lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:22,600 creating build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:22,601 copying lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:22,603 creating build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:22,604 copying lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:22,607 creating build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:22,608 copying lm_eval/tasks/global_mmlu/full/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:22,611 creating build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:22,612 copying lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:22,614 creating build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:22,615 copying lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:22,618 creating build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:22,619 copying lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:22,621 creating build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:22,622 copying lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:22,625 creating build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:22,626 copying lm_eval/tasks/global_mmlu/default/id/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:22,629 creating build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:22,630 copying lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:22,632 creating build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:22,633 copying lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:22,636 creating build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:22,637 copying lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:22,639 creating build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:22,640 copying lm_eval/tasks/global_mmlu/default/de/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:22,642 creating build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:22,643 copying lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:22,646 creating build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:22,647 copying lm_eval/tasks/global_mmlu/default/es/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:22,649 creating build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:22,651 copying lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:22,653 creating build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:22,654 copying lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:22,657 creating build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:22,658 copying lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:22,660 creating build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:22,661 copying lm_eval/tasks/global_mmlu/default/en/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:22,663 creating build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:22,664 copying lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:22,667 creating build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:22,668 copying lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:22,670 creating build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:22,671 copying lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:22,673 creating build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:22,674 copying lm_eval/tasks/global_mmlu/default/it/utils.py -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:22,677 creating build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:22,678 copying lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:22,682 creating build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:15:22,684 copying lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:15:22,686 creating build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:22,687 copying lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:22,690 creating build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:22,691 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:22,694 creating build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:15:22,695 copying lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:15:22,697 creating build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:22,698 copying lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:22,701 creating build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:22,702 copying lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:22,704 creating build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:22,705 copying lm_eval/tasks/include/few_shot_en/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:22,708 creating build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:15:22,709 copying lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:15:22,711 creating build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:22,712 copying lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:22,715 creating build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:22,716 copying lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:22,718 creating build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:15:22,719 copying lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:15:22,722 creating build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:22,723 copying lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:22,725 creating build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:15:22,726 copying lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:15:22,728 creating build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:22,729 copying lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:22,732 creating build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:22,733 copying lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:22,735 creating build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:15:22,736 copying lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:15:22,738 creating build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:15:22,739 copying lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:15:22,742 creating build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:15:22,742 copying lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:15:22,745 creating build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:15:22,746 copying lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:15:22,748 creating build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:22,749 copying lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:22,752 creating build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:22,753 copying lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:22,755 creating build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:15:22,756 copying lm_eval/tasks/include/few_shot_en/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:15:22,758 creating build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:22,759 copying lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:22,762 creating build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:22,763 copying lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:22,765 creating build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:22,766 copying lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:22,768 creating build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:22,770 copying lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:22,772 creating build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:22,773 copying lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:22,775 creating build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:15:22,776 copying lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:15:22,779 creating build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:15:22,780 copying lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:15:22,783 creating build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:22,784 copying lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:22,786 creating build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:22,787 copying lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:22,789 creating build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:15:22,790 copying lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:15:22,793 creating build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:15:22,794 copying lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:15:22,796 creating build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:22,797 copying lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:22,800 creating build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:15:22,800 copying lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:15:22,803 creating build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:22,804 copying lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:22,806 creating build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:15:22,807 copying lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:15:22,809 creating build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:22,810 copying lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:22,812 creating build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:15:22,813 copying lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:15:22,816 creating build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:15:22,817 copying lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:15:22,819 creating build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:15:22,820 copying lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:15:22,823 creating build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:15:22,824 copying lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:15:22,826 creating build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:22,827 copying lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:22,830 creating build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:22,831 copying lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:22,833 creating build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:15:22,835 copying lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:15:22,838 creating build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:22,839 copying lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:22,841 creating build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:22,842 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:22,845 creating build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:15:22,846 copying lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:15:22,848 creating build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:22,849 copying lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:22,852 creating build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:22,852 copying lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:22,855 creating build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:22,856 copying lm_eval/tasks/include/few_shot_og/French/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:22,858 creating build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:15:22,859 copying lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:15:22,862 creating build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:22,863 copying lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:22,865 creating build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:22,866 copying lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:22,868 creating build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:15:22,869 copying lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:15:22,872 creating build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:22,873 copying lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:22,875 creating build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:15:22,876 copying lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:15:22,878 creating build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:22,880 copying lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:22,882 creating build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:22,883 copying lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:22,886 creating build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:15:22,887 copying lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:15:22,889 creating build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:15:22,890 copying lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:15:22,892 creating build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:15:22,893 copying lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:15:22,896 creating build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:15:22,897 copying lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:15:22,899 creating build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:22,901 copying lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:22,903 creating build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:22,904 copying lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:22,907 creating build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:15:22,908 copying lm_eval/tasks/include/few_shot_og/German/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:15:22,910 creating build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:22,911 copying lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:22,913 creating build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:22,914 copying lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:22,917 creating build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:22,918 copying lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:22,920 creating build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:22,921 copying lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:22,924 creating build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:22,925 copying lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:22,927 creating build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:15:22,928 copying lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:15:22,931 creating build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:15:22,932 copying lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:15:22,934 creating build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:22,935 copying lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:22,938 creating build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:22,939 copying lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:22,941 creating build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:15:22,942 copying lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:15:22,944 creating build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:15:22,946 copying lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:15:22,948 creating build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:22,949 copying lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:22,951 creating build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:15:22,952 copying lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:15:22,955 creating build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:22,956 copying lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:22,958 creating build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:15:22,959 copying lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:15:22,962 creating build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:22,963 copying lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:22,966 creating build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:15:22,967 copying lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:15:22,969 creating build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:15:22,970 copying lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:15:22,972 creating build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:15:22,973 copying lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:15:22,975 creating build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:15:22,976 copying lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:15:22,979 creating build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:22,980 copying lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:22,982 creating build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:22,983 copying lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:22,985 creating build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:15:22,987 copying lm_eval/tasks/include/default/Ukrainian/utils.py -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:15:22,989 creating build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:22,990 copying lm_eval/tasks/include/default/Hindi/utils.py -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:22,993 creating build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:22,994 copying lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:22,996 creating build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:15:22,997 copying lm_eval/tasks/include/default/Hungarian/utils.py -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:15:22,999 creating build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:23,000 copying lm_eval/tasks/include/default/Dutch/utils.py -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:23,003 creating build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:23,004 copying lm_eval/tasks/include/default/Arabic/utils.py -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:23,006 creating build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:23,007 copying lm_eval/tasks/include/default/French/utils.py -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:23,010 creating build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:15:23,011 copying lm_eval/tasks/include/default/Nepali/utils.py -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:15:23,013 creating build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:23,014 copying lm_eval/tasks/include/default/Estonian/utils.py -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:23,017 creating build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:23,018 copying lm_eval/tasks/include/default/Portuguese/utils.py -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:23,020 creating build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:15:23,021 copying lm_eval/tasks/include/default/Hebrew/utils.py -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:15:23,024 creating build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:23,025 copying lm_eval/tasks/include/default/Finnish/utils.py -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:23,028 creating build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:15:23,029 copying lm_eval/tasks/include/default/Japanese/utils.py -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:15:23,031 creating build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:23,032 copying lm_eval/tasks/include/default/Indonesian/utils.py -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:23,035 creating build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:23,035 copying lm_eval/tasks/include/default/Lithuanian/utils.py -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:23,038 creating build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:15:23,039 copying lm_eval/tasks/include/default/Bulgarian/utils.py -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:15:23,041 creating build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:15:23,042 copying lm_eval/tasks/include/default/Tamil/utils.py -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:15:23,044 creating build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:15:23,045 copying lm_eval/tasks/include/default/Belarusian/utils.py -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:15:23,048 creating build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:15:23,049 copying lm_eval/tasks/include/default/Serbian/utils.py -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:15:23,051 creating build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:23,052 copying lm_eval/tasks/include/default/Albanian/utils.py -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:23,054 creating build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:23,055 copying lm_eval/tasks/include/default/Italian/utils.py -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:23,058 creating build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:15:23,059 copying lm_eval/tasks/include/default/German/utils.py -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:15:23,061 creating build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:23,062 copying lm_eval/tasks/include/default/Telugu/utils.py -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:23,064 creating build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:23,065 copying lm_eval/tasks/include/default/Bengali/utils.py -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:23,067 creating build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:23,068 copying lm_eval/tasks/include/default/North Macedonian/utils.py -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:23,071 creating build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:23,072 copying lm_eval/tasks/include/default/Persian/utils.py -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:23,074 creating build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:23,075 copying lm_eval/tasks/include/default/Armenian/utils.py -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:23,077 creating build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:15:23,078 copying lm_eval/tasks/include/default/Basque/utils.py -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:15:23,081 creating build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:15:23,082 copying lm_eval/tasks/include/default/Vietnamese/utils.py -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:15:23,084 creating build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:23,085 copying lm_eval/tasks/include/default/Greek/utils.py -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:23,087 creating build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:23,088 copying lm_eval/tasks/include/default/Chinese/utils.py -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:23,091 creating build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:15:23,092 copying lm_eval/tasks/include/default/Polish/utils.py -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:15:23,094 creating build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:15:23,095 copying lm_eval/tasks/include/default/Urdu/utils.py -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:15:23,098 creating build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:23,099 copying lm_eval/tasks/include/default/Spanish/utils.py -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:23,101 creating build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:15:23,102 copying lm_eval/tasks/include/default/Malay/utils.py -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:15:23,104 creating build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:23,105 copying lm_eval/tasks/include/default/Malayalam/utils.py -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:23,108 creating build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:15:23,109 copying lm_eval/tasks/include/default/Croatian/utils.py -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:15:23,111 creating build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:23,112 copying lm_eval/tasks/include/default/Turkish/utils.py -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:23,114 creating build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:15:23,115 copying lm_eval/tasks/include/default/Korean/utils.py -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:15:23,118 creating build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:15:23,119 copying lm_eval/tasks/include/default/Georgian/utils.py -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:15:23,121 creating build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:15:23,122 copying lm_eval/tasks/include/default/Kazakh/utils.py -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:15:23,125 creating build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:15:23,126 copying lm_eval/tasks/include/default/Tagalog/utils.py -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:15:23,128 creating build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:23,129 copying lm_eval/tasks/include/default/Russian/utils.py -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:23,132 creating build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:23,133 copying lm_eval/tasks/include/default/Uzbek/utils.py -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:23,135 creating build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:23,137 copying lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:23,139 creating build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:23,140 copying lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:23,143 creating build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:23,144 copying lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:23,146 creating build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:23,147 copying lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:23,150 creating build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:23,151 copying lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:23,154 creating build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:23,156 copying lm_eval/tasks/tmmluplus/default/utils.py -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:23,158 copying lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:23,162 creating build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:23,163 copying lm_eval/tasks/bbh/zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:23,166 creating build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:23,167 copying lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:23,172 creating build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:23,174 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:23,177 creating build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:23,178 copying lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:23,181 creating build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:15:23,183 copying lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:15:23,184 copying lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:15:23,187 creating build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:15:23,188 copying lm_eval/tasks/super_glue/cb/aggregate.py -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:15:23,190 copying lm_eval/tasks/super_glue/cb/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:15:23,193 creating build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:15:23,194 copying lm_eval/tasks/super_glue/record/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:15:23,196 copying lm_eval/tasks/super_glue/record/util.py -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:15:23,198 creating build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:15:23,199 copying lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:15:23,201 creating build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:15:23,202 copying lm_eval/tasks/super_glue/copa/utils.py -> build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:15:23,206 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:23,207 copying lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:23,210 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:23,211 copying lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:23,214 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:23,215 copying lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:23,218 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:23,219 copying lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:23,221 creating build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:23,222 copying lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:23,225 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:23,226 copying lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:23,229 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:23,230 copying lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:23,232 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:23,233 copying lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:23,236 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:23,237 copying lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:23,239 creating build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:23,240 copying lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:23,243 creating build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:23,244 copying lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:23,247 creating build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:23,247 copying lm_eval/tasks/score/math/math_grader.py -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:23,250 copying lm_eval/tasks/score/math/utils_math.py -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:23,253 creating build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:15:23,254 copying lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:15:23,257 creating build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:23,259 copying lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:23,262 creating build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:23,264 copying lm_eval/tasks/global_piqa/parallel_generation/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:23,267 creating build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:23,268 copying lm_eval/tasks/global_piqa/nonparallel_cloze/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:23,271 creating build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:23,273 copying lm_eval/tasks/global_piqa/parallel_cloze/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:23,276 creating build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:23,278 copying lm_eval/tasks/global_piqa/nonparallel_generation/_generate_config.py -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:23,281 creating build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:15:23,283 copying lm_eval/tasks/afrobench/adr/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:15:23,286 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:15:23,287 copying lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:15:23,290 creating build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:15:23,291 copying lm_eval/tasks/afrobench/salt/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:15:23,295 creating build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:15:23,296 copying lm_eval/tasks/afrobench/belebele/utils.py -> build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:15:23,299 creating build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:15:23,301 copying lm_eval/tasks/afrobench/masakhapos/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:15:23,303 copying lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:15:23,307 creating build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:15:23,308 copying lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:15:23,311 creating build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:15:23,313 copying lm_eval/tasks/afrobench/masakhanews/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:15:23,316 creating build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:15:23,317 copying lm_eval/tasks/afrobench/afriqa/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:15:23,320 creating build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:15:23,322 copying lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:15:23,325 creating build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:15:23,326 copying lm_eval/tasks/afrobench/afrisenti/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:15:23,329 creating build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:15:23,329 copying lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:15:23,332 creating build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:15:23,333 copying lm_eval/tasks/afrobench/flores/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:15:23,336 creating build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:15:23,337 copying lm_eval/tasks/afrobench/naijarc/utils.py -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:15:23,340 creating build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:15:23,340 copying lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:15:23,343 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:15:23,344 copying lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:15:23,347 creating build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:15:23,347 copying lm_eval/tasks/afrobench/xlsum/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:15:23,350 creating build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:15:23,351 copying lm_eval/tasks/afrobench/sib/utils.py -> build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:15:23,355 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:23,357 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:23,359 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:23,360 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:23,362 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:23,363 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:23,366 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:23,367 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:23,369 creating build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:23,370 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:23,376 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:23,377 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:23,380 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:23,381 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:23,383 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:23,384 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:23,387 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:23,388 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:23,390 creating build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:23,391 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:23,394 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:23,395 copying lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:23,397 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:23,398 copying lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:23,401 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:23,402 copying lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:23,404 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:23,405 copying lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:23,407 creating build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:23,408 copying lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:23,410 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:23,411 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:23,414 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:23,415 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:23,417 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:23,418 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:23,421 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:23,422 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:23,424 creating build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:23,425 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:23,428 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:23,428 copying lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:23,431 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:23,432 copying lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:23,434 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:23,435 copying lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:23,438 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:23,439 copying lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:23,441 creating build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:23,442 copying lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:23,446 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:23,448 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:23,451 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:23,452 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:23,454 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:23,456 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:23,459 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:23,460 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:23,462 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:23,464 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:23,466 creating build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:23,467 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:23,470 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:23,471 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:23,473 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:23,475 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:23,476 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:23,478 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:23,480 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:23,481 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:23,483 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:23,485 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:23,486 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:23,488 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:23,491 creating build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:23,492 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:23,494 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:23,499 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:15:23,501 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:15:23,503 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:15:23,504 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:15:23,506 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:15:23,507 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:15:23,510 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:15:23,511 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:15:23,513 creating build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:15:23,514 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:15:23,522 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:15:23,523 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:15:23,526 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:15:23,527 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:15:23,530 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:15:23,531 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:15:23,533 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:15:23,534 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:15:23,537 creating build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:15:23,538 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:15:23,543 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:15:23,544 copying lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:15:23,547 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:15:23,547 copying lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:15:23,550 creating build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:15:23,551 copying lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:15:23,553 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:15:23,554 copying lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:15:23,557 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:15:23,558 copying lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:15:23,560 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:15:23,561 copying lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:15:23,563 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:15:23,565 copying lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:15:23,567 creating build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:15:23,568 copying lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:15:23,571 creating build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:15:23,572 copying lm_eval/tasks/mmlusr/answer_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:15:23,574 creating build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:15:23,575 copying lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:15:23,578 creating build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:15:23,579 copying lm_eval/tasks/mmlusr/question_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:15:23,581 creating build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:15:23,582 copying lm_eval/tasks/ifeval/multilingual/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:15:23,585 copying lm_eval/tasks/ifeval/multilingual/utils.py -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:15:23,587 creating build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:15:23,589 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:15:23,591 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:15:23,593 copying lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:15:23,596 creating build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:15:23,597 copying lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:15:23,600 copying lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:15:23,604 copying lm_eval/tasks/ifeval/multilingual/instructions/__init__.py -> build/lib/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:15:23,606 creating build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:15:23,607 copying lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:15:23,610 creating build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:15:23,611 copying lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:15:23,613 creating build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:15:23,614 copying lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:15:23,616 creating build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:15:23,618 copying lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:15:23,621 creating build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:15:23,623 copying lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:15:23,626 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:15:23,627 copying lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:15:23,631 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:15:23,632 copying lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:15:23,635 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:15:23,636 copying lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:15:23,639 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:15:23,640 copying lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:15:23,643 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:15:23,644 copying lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:15:23,647 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:15:23,648 copying lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:15:23,652 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:15:23,653 copying lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:15:23,656 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:15:23,657 copying lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:15:23,660 creating build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:15:23,662 copying lm_eval/tasks/aradice/openbookqa/metrics.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:15:23,664 copying lm_eval/tasks/aradice/openbookqa/utils.py -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:15:23,666 creating build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:15:23,667 copying lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:15:23,669 creating build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:15:23,670 copying lm_eval/tasks/aradice/piqa/metrics.py -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:15:23,672 creating build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:15:23,673 copying lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:15:23,675 copying lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:15:23,678 creating build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:15:23,679 copying lm_eval/tasks/aradice/winogrande/metrics.py -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:15:23,681 copying lm_eval/tasks/aradice/winogrande/utils.py -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:15:23,683 creating build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:15:23,684 copying lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:15:23,686 copying lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:15:23,689 creating build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:15:23,690 copying lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:15:23,691 copying lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:15:23,694 creating build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:15:23,695 copying lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:15:23,697 copying lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:15:23,699 creating build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:15:23,700 copying lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:15:23,702 copying lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:15:23,704 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:15:23,706 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:15:23,708 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:15:23,710 creating build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:15:23,711 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:15:23,713 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:15:23,717 creating build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:15:23,719 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:15:23,726 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:15:23,729 copying lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:15:23,733 creating build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:15:23,736 copying lm_eval/tasks/glue/mnli/utils.py -> build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:15:23,745 creating build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:15:23,748 copying lm_eval/tasks/e2lmc/noor/_generate_configs.py -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:15:23,752 creating build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:15:23,754 copying lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:15:23,758 creating build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:15:23,761 copying lm_eval/tasks/leaderboard/gpqa/utils.py -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:15:23,764 creating build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:15:23,766 copying lm_eval/tasks/leaderboard/math/utils.py -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:15:23,770 creating build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:15:23,772 copying lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:15:23,776 copying lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:15:23,779 copying lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:15:23,785 copying lm_eval/tasks/leaderboard/ifeval/utils.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:15:23,790 creating build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:15:23,791 copying lm_eval/tasks/leaderboard/musr/utils.py -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:15:23,794 creating build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:15:23,796 copying lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:15:23,817 running egg_info 2026-09-01T00:15:23,827 writing lm_eval.egg-info/PKG-INFO 2026-09-01T00:15:23,851 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2026-09-01T00:15:23,853 writing entry points to lm_eval.egg-info/entry_points.txt 2026-09-01T00:15:23,865 writing requirements to lm_eval.egg-info/requires.txt 2026-09-01T00:15:23,867 writing top-level names to lm_eval.egg-info/top_level.txt 2026-09-01T00:15:28,276 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:29,599 reading manifest template 'MANIFEST.in' 2026-09-01T00:15:29,599 warning: manifest_maker: MANIFEST.in, line 1: 'recursive-include' expects ... 2026-09-01T00:15:29,601 adding license file 'LICENSE.md' 2026-09-01T00:15:30,784 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2026-09-01T00:15:34,298 copying lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:34,301 copying lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:34,303 copying lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:34,304 copying lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:34,306 copying lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:15:34,308 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,311 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,313 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,316 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,318 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,321 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,324 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,326 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:15:34,329 creating build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,330 copying lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,332 copying lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,335 copying lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,337 copying lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,339 copying lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,341 copying lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,343 copying lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:15:34,345 copying lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,347 copying lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,349 copying lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,352 copying lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,354 copying lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,356 copying lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,358 copying lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,360 copying lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:15:34,363 creating build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,364 copying lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,366 copying lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,368 copying lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,370 copying lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,373 copying lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,375 copying lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,377 copying lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:15:34,380 copying lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:15:34,382 copying lm_eval/tasks/mbpp/mbpp.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:15:34,384 copying lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:15:34,386 copying lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:15:34,388 copying lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:15:34,390 copying lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:15:34,392 copying lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:15:34,394 creating build/lib/lm_eval/tasks/siqa 2026-09-01T00:15:34,395 copying lm_eval/tasks/siqa/siqa.yaml -> build/lib/lm_eval/tasks/siqa 2026-09-01T00:15:34,398 copying lm_eval/tasks/c4/c4.yaml -> build/lib/lm_eval/tasks/c4 2026-09-01T00:15:34,399 creating build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,401 copying lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,403 copying lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,405 copying lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,407 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,409 copying lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,411 copying lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,413 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,415 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,417 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,419 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,421 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,423 copying lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,425 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,427 copying lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,429 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,431 copying lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,433 copying lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,435 copying lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,437 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,439 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,441 copying lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,443 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,445 copying lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,447 copying lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,449 copying lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,451 copying lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,453 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,456 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,458 copying lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,460 copying lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,462 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,464 copying lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,466 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,468 copying lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,470 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,472 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,474 copying lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,476 copying lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,478 copying lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,480 copying lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,482 copying lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,484 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,487 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,489 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,491 copying lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,493 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,495 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,497 copying lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,499 copying lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,501 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,503 copying lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,506 copying lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,508 copying lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,510 copying lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,513 copying lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,515 copying lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,517 copying lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,519 copying lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:15:34,521 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:15:34,523 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:15:34,525 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:15:34,527 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:15:34,529 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:15:34,531 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:15:34,533 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:15:34,536 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:15:34,538 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:15:34,540 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,542 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,544 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,546 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,548 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,550 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,553 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,555 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,557 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,560 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:15:34,562 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:15:34,563 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:15:34,566 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:15:34,568 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:15:34,569 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,572 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,574 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,575 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,578 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,580 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,582 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,584 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,586 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,588 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,590 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,592 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,594 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,596 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,598 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,600 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,602 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,604 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,606 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,608 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,610 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,612 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,614 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,616 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,618 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,621 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,623 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,625 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,628 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,630 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,632 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,634 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,636 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,639 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,642 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,644 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,647 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,650 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,652 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,655 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,657 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,660 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,662 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,665 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,668 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,671 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,675 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,683 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,692 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,702 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,707 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,710 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,712 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,714 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,716 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,718 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,720 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,723 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:15:34,725 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:15:34,728 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:15:34,731 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,734 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,737 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,740 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,743 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,747 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,751 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,755 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,759 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,762 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,766 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,770 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,773 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,776 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,780 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,784 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,788 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,792 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,796 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,798 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,800 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,802 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,804 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,806 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,808 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,810 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,812 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,814 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,816 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,818 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,820 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,822 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,824 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,826 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,828 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,830 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,832 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,834 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,836 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,838 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,840 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,842 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,844 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,846 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,848 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,850 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,852 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,854 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,857 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,859 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,861 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,863 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,865 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,867 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,869 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,871 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,873 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,876 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,878 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:15:34,880 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:15:34,882 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:15:34,884 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:15:34,886 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:15:34,888 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:15:34,890 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:15:34,893 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:15:34,895 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:15:34,897 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:15:34,899 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:15:34,901 creating build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,902 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,904 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,906 copying lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,908 copying lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,910 copying lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,912 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,914 copying lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,917 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,918 copying lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,920 copying lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,922 copying lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,924 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,927 copying lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,928 copying lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,930 copying lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,933 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,934 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,937 copying lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,939 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,940 copying lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,942 copying lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,945 copying lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,947 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,949 copying lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,951 copying lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,953 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,955 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,957 copying lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,959 copying lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,961 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,964 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,966 copying lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,968 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,970 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,972 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,974 copying lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,977 copying lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,979 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,981 copying lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,983 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,985 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,987 copying lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,989 copying lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,991 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,993 copying lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,996 copying lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,998 copying lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:34,999 copying lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,001 copying lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,003 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,006 copying lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,007 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,009 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,011 copying lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,013 copying lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,015 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,017 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,019 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,021 copying lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,023 copying lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,025 copying lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,027 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,029 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,031 copying lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,033 copying lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,035 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,037 copying lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,039 copying lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,042 copying lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,044 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,045 copying lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,047 copying lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,049 copying lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,051 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,053 copying lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,055 copying lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,057 copying lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,059 copying lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,061 copying lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,063 copying lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,065 copying lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,067 copying lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,069 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,071 copying lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,073 copying lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:15:35,075 creating build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,076 copying lm_eval/tasks/ulqa/lambada_uyghur.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,078 copying lm_eval/tasks/ulqa/celep1.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,080 copying lm_eval/tasks/ulqa/ulqa_.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,082 copying lm_eval/tasks/ulqa/uleval.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,085 copying lm_eval/tasks/ulqa/celep2.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,087 copying lm_eval/tasks/ulqa/ulqa.yaml -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:15:35,089 creating build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,089 copying lm_eval/tasks/ulqa/ulut/wag.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,092 copying lm_eval/tasks/ulqa/ulut/nug.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,094 copying lm_eval/tasks/ulqa/ulut/ulut.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,096 copying lm_eval/tasks/ulqa/ulut/wub.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,098 copying lm_eval/tasks/ulqa/ulut/wum.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,100 copying lm_eval/tasks/ulqa/ulut/wsm.yaml -> build/lib/lm_eval/tasks/ulqa/ulut 2026-09-01T00:15:35,102 copying lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:15:35,104 copying lm_eval/tasks/lingoly/lingoly_group.yaml -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:15:35,106 copying lm_eval/tasks/lingoly/lingoly_context.yaml -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:15:35,108 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,110 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,112 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,114 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,116 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,118 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,119 copying lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,121 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,123 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,125 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,127 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,129 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,131 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,133 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,135 copying lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:15:35,137 copying lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:15:35,139 copying lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:15:35,141 copying lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,143 copying lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,145 copying lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,147 copying lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,148 copying lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,151 copying lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,153 copying lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,155 copying lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,157 copying lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,159 copying lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,161 copying lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,163 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,165 copying lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,167 copying lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,170 copying lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,172 copying lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,174 copying lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,176 copying lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,178 copying lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,180 copying lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,182 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,184 copying lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,186 copying lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,189 copying lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,191 copying lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,193 copying lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,195 copying lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,197 copying lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,199 copying lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,201 copying lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,203 copying lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,205 copying lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,207 copying lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,209 copying lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,211 copying lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,213 copying lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,215 copying lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,217 copying lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,220 copying lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,222 copying lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,224 copying lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,226 copying lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,228 copying lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,230 copying lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,232 copying lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,234 copying lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,236 copying lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:15:35,238 copying lm_eval/tasks/aime/aime25.yaml -> build/lib/lm_eval/tasks/aime 2026-09-01T00:15:35,240 copying lm_eval/tasks/aime/aime24.yaml -> build/lib/lm_eval/tasks/aime 2026-09-01T00:15:35,242 copying lm_eval/tasks/aime/aime.yaml -> build/lib/lm_eval/tasks/aime 2026-09-01T00:15:35,244 copying lm_eval/tasks/icelandic_winogrande/default.yaml -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:15:35,247 copying lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:15:35,249 copying lm_eval/tasks/xcopa/default_sw.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,251 copying lm_eval/tasks/xcopa/default_th.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,253 copying lm_eval/tasks/xcopa/default_et.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,256 copying lm_eval/tasks/xcopa/default_ht.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,258 copying lm_eval/tasks/xcopa/default_qu.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,260 copying lm_eval/tasks/xcopa/default_vi.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,261 copying lm_eval/tasks/xcopa/default_it.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,263 copying lm_eval/tasks/xcopa/_xcopa.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,265 copying lm_eval/tasks/xcopa/default_tr.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,267 copying lm_eval/tasks/xcopa/default_zh.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,269 copying lm_eval/tasks/xcopa/default_id.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,272 copying lm_eval/tasks/xcopa/default_ta.yaml -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:15:35,274 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,277 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,280 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,282 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,284 copying lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,287 copying lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,290 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,293 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,298 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,302 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,306 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,310 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,314 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,318 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,321 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,326 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,331 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,336 copying lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,341 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,348 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,354 copying lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,359 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,363 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,367 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,370 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,373 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,377 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,381 copying lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,386 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,390 copying lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,392 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,395 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,397 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,401 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,404 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,406 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,409 copying lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,411 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,414 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,416 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,419 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,421 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,424 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,426 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,429 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,431 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,434 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,436 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,439 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,442 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,444 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,447 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,450 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,452 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,455 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,458 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,460 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,463 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,465 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,468 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,470 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,473 copying lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:15:35,475 copying lm_eval/tasks/cruxeval/cruxeval_input_08.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:35,478 copying lm_eval/tasks/cruxeval/cruxeval_output.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:35,480 copying lm_eval/tasks/cruxeval/cruxeval_input.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:35,482 copying lm_eval/tasks/cruxeval/cruxeval_output_08.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:35,485 copying lm_eval/tasks/cruxeval/cruxeval_input_cot.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:35,487 copying lm_eval/tasks/cruxeval/cruxeval_output_cot.yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:15:35,490 copying lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,493 copying lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,495 copying lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,498 copying lm_eval/tasks/translation/wmt16_de-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,500 copying lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,503 copying lm_eval/tasks/translation/wmt16_en-de.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,506 copying lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,509 copying lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:15:35,512 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,515 copying lm_eval/tasks/galician_bench/galician_bench.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,519 copying lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,521 copying lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,525 copying lm_eval/tasks/galician_bench/galcola.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,528 copying lm_eval/tasks/galician_bench/paws_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,531 copying lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,534 copying lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,536 copying lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,538 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,541 copying lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,543 copying lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,545 copying lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:15:35,547 copying lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,550 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,552 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,554 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,555 copying lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,558 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,559 copying lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,561 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,563 copying lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,565 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,567 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,569 copying lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,571 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,573 copying lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,575 copying lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,577 copying lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,580 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:15:35,581 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_history_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,583 copying lm_eval/tasks/greekmmlu/greekmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,585 copying lm_eval/tasks/greekmmlu/greekmmlu_driving_rules.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,587 copying lm_eval/tasks/greekmmlu/greekmmlu_accounting.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,589 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_history_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,591 copying lm_eval/tasks/greekmmlu/greekmmlu_agriculture_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,593 copying lm_eval/tasks/greekmmlu/greekmmlu_prehistory.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,596 copying lm_eval/tasks/greekmmlu/greekmmlu_economics_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,598 copying lm_eval/tasks/greekmmlu/greekmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,600 copying lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,602 copying lm_eval/tasks/greekmmlu/greekmmlu_world_history.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,604 copying lm_eval/tasks/greekmmlu/greekmmlu_management_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,606 copying lm_eval/tasks/greekmmlu/greekmmlu_maritime_safety_and_rescue_operations.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,608 copying lm_eval/tasks/greekmmlu/greekmmlu_mathematics.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,610 copying lm_eval/tasks/greekmmlu/greekmmlu_physics_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,612 copying lm_eval/tasks/greekmmlu/_greekmmlu_other.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,613 copying lm_eval/tasks/greekmmlu/greekmmlu_management_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,615 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_history_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,617 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_traditions.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,619 copying lm_eval/tasks/greekmmlu/greekmmlu_education_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,621 copying lm_eval/tasks/greekmmlu/greekmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,623 copying lm_eval/tasks/greekmmlu/greekmmlu_geography_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,625 copying lm_eval/tasks/greekmmlu/greekmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,627 copying lm_eval/tasks/greekmmlu/greekmmlu_art_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,629 copying lm_eval/tasks/greekmmlu/_greekmmlu_stem.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,631 copying lm_eval/tasks/greekmmlu/greekmmlu_computer_networks_and_security.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,633 copying lm_eval/tasks/greekmmlu/greekmmlu_medicine_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,635 copying lm_eval/tasks/greekmmlu/greekmmlu_physics_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,637 copying lm_eval/tasks/greekmmlu/greekmmlu_agriculture_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,639 copying lm_eval/tasks/greekmmlu/greekmmlu_computer_science_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,641 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_mythology.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,643 copying lm_eval/tasks/greekmmlu/greekmmlu_biology.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,645 copying lm_eval/tasks/greekmmlu/greekmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,647 copying lm_eval/tasks/greekmmlu/greekmmlu_medicine_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,649 copying lm_eval/tasks/greekmmlu/_greekmmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,651 copying lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,653 copying lm_eval/tasks/greekmmlu/greekmmlu_art_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,655 copying lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_primary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,657 copying lm_eval/tasks/greekmmlu/greekmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,659 copying lm_eval/tasks/greekmmlu/greekmmlu_greek_literature.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,661 copying lm_eval/tasks/greekmmlu/greekmmlu_physics_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,663 copying lm_eval/tasks/greekmmlu/greekmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,665 copying lm_eval/tasks/greekmmlu/greekmmlu_law.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,667 copying lm_eval/tasks/greekmmlu/greekmmlu_education_professional.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,669 copying lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_secondary_school.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,671 copying lm_eval/tasks/greekmmlu/_greekmmlu_humanities.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,673 copying lm_eval/tasks/greekmmlu/greekmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,675 copying lm_eval/tasks/greekmmlu/greekmmlu_art_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,677 copying lm_eval/tasks/greekmmlu/_greekmmlu.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,679 copying lm_eval/tasks/greekmmlu/greekmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:15:35,685 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,690 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,693 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,700 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,702 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,704 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,706 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,708 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,710 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,713 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,715 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,717 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,719 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,721 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,723 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,725 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,727 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,730 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,732 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,734 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,736 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,739 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,741 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,743 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,745 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,748 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,750 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,752 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,754 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,756 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,758 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,760 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,762 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,765 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,767 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,769 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,771 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,773 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,775 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,778 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,780 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,782 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,784 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,787 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,789 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,791 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,793 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,795 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,798 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,800 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,802 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,804 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,806 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,808 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,810 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,812 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,814 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,816 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,818 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,820 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,822 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,824 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,826 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,828 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,831 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,833 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,835 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,837 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,839 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,841 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,843 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,845 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,848 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,850 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,852 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,854 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,858 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,861 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,863 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,865 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,867 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,869 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,871 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,873 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,875 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,877 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,879 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,881 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,883 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,886 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,888 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,890 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,892 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,894 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,896 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,899 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,901 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,903 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,906 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,910 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,912 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,915 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,917 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,920 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,922 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,925 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,929 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,933 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,943 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,946 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,948 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,950 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,952 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,955 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,957 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,959 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,961 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,964 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,966 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,968 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,971 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,973 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,975 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,978 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,980 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,982 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,984 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,987 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,989 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,991 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,994 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,997 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:35,999 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,002 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,004 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,006 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,009 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,011 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,014 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,016 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,019 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,021 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,024 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,026 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,028 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,031 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,033 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,035 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,038 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,040 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,042 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,045 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,047 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,050 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,052 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,054 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,057 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,059 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,061 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,063 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,066 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,068 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,071 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,073 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,075 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,078 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,080 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,083 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,085 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,088 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,090 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,092 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,095 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,097 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,099 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,102 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,104 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,107 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,109 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,111 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,114 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,116 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,119 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,121 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,124 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,126 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,128 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,131 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,133 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,135 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,138 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,140 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,142 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,145 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,147 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,149 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,152 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,154 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,156 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,159 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,161 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,163 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,166 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,168 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,170 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,173 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,175 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,178 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,180 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,182 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,185 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,188 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,190 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,192 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,195 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,197 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,199 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,201 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,203 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,205 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,207 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,210 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,211 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,213 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,216 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,218 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,220 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,222 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,224 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,227 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,229 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,231 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,233 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,235 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,237 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,240 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,243 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,246 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,248 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,251 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,254 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,257 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,259 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,262 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,265 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,268 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,270 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,273 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,276 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,278 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,281 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,284 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,286 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,289 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,292 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,294 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,297 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,300 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,303 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,306 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,309 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,312 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,315 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,317 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,320 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,323 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,326 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,328 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,331 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,334 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,337 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,339 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,342 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,344 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,346 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,348 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,350 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,352 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,354 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,356 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,358 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,361 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,363 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,365 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,367 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,369 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,371 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,373 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,375 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,378 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,380 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,382 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,384 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,386 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,388 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,390 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,392 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,394 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,396 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,398 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,401 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,403 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,405 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,407 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,409 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,412 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,414 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,416 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,418 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,420 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,422 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,424 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,426 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,428 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,432 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,435 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,437 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,439 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,441 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,443 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,446 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,448 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,450 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,452 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,454 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,457 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,459 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,461 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,463 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,465 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,467 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,469 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,471 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,474 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,476 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,478 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,480 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,482 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,484 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,486 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,488 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,490 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,493 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,495 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,498 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,500 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,503 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,505 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,507 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,509 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,511 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,513 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,515 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,517 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,519 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,522 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,524 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,526 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,528 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,530 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,532 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,534 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,536 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,538 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,540 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,542 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,544 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,546 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,548 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,551 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,553 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,555 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,557 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,559 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,561 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,564 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,566 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,568 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,570 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,572 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,574 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,576 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,578 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,580 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,582 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,584 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,586 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,588 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,591 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,593 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,595 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,597 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,599 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,601 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,603 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,605 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,607 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,610 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,612 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,614 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,617 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,619 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,621 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,623 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,625 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,627 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,629 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,631 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,633 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,635 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,637 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,639 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,641 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,643 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,645 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,648 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,650 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,652 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,654 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,656 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,658 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,660 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,662 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,664 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,667 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,669 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,671 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,673 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,675 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,677 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,679 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,681 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,683 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,685 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,687 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,689 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,691 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,693 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,695 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,697 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,699 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,701 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,703 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,705 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,707 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,709 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,711 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,713 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,715 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,717 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,719 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,722 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,724 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,726 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,728 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,730 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,732 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,735 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,737 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,739 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,741 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,743 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,745 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,747 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,749 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,751 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,753 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,755 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,757 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,759 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,761 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,763 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,766 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,768 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,770 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,772 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,774 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,776 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,779 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,781 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,783 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,785 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,787 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,789 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,791 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,793 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,795 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,798 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,800 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,802 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,804 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,806 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,808 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,810 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,812 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,814 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,816 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,818 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,820 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,822 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,825 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,827 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,829 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,831 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,833 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,835 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,837 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,839 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,841 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,843 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,846 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,848 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,849 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,852 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,854 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,856 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,858 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,860 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,862 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,864 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,866 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,869 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,871 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,873 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,875 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,877 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,879 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,882 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,884 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,886 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,888 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,890 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,892 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,894 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,896 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,899 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,901 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,903 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,905 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,907 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,909 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,910 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,912 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,914 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,916 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,918 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,920 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,922 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,924 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,926 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,928 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,930 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,932 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,934 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,936 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,938 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,940 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,942 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,944 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,946 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,948 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,950 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,953 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,955 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,957 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,959 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,961 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,963 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,965 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,967 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,969 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,971 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,973 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,975 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,977 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,979 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,981 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,983 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,985 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,987 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,989 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,991 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,993 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,995 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:36,998 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,000 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,002 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,004 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,006 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,008 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,010 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,013 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,015 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,017 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,019 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,021 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,023 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,025 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,027 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,029 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,031 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,033 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,035 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,037 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,039 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,042 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,044 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,046 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,049 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,051 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,054 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,057 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,059 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,062 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,064 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,067 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,069 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,072 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,075 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,077 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,080 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,082 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,085 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,087 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,090 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,092 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,094 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,097 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,099 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,102 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,104 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,107 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,109 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,112 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,114 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,117 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,119 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,122 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,124 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,127 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,130 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,132 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,135 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,137 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,140 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,142 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,145 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,147 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,149 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,151 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,153 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,155 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,157 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,159 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,161 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,163 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,165 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,167 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,169 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,171 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,173 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,175 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,177 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,179 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,181 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,183 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,185 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,188 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,190 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,192 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,194 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,196 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,198 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,200 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,202 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,204 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,206 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,208 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,210 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,212 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,214 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,217 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,219 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,221 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,223 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,225 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,227 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,229 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,231 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,233 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,235 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,237 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,239 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,241 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,243 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,246 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,248 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,250 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,252 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,254 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,256 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,258 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,260 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,262 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,264 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,266 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,268 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,270 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,272 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,274 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,276 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,279 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,281 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,283 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,285 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,287 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,289 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,291 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,293 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,295 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,297 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,299 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,301 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,304 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,306 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,308 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,310 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,312 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,314 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,316 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,318 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,320 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,322 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,324 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,326 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,328 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,330 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,332 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,334 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,337 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,339 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,341 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,343 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,345 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,347 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,349 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,352 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,354 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,356 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,358 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,360 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,362 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,365 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,367 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,369 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,371 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,373 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,375 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,377 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,379 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,381 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,383 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,385 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,387 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,389 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,391 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,393 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,396 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,398 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,400 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,402 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,404 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,406 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,408 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,410 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,412 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,414 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,417 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,419 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,421 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,423 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,425 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,427 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,429 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,431 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,433 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,435 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,437 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,439 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,441 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,443 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,445 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,447 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,449 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,452 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,454 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,456 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,458 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,460 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,462 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,464 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,466 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,469 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,471 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,473 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,475 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,477 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,479 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,482 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,484 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,486 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,488 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,490 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,492 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,494 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,496 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,499 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,501 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,503 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,505 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,507 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,509 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,512 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,514 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,516 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,518 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,521 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,523 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,525 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,527 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,530 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,532 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,534 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,536 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,539 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,541 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,543 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,545 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,547 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,550 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,552 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,554 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,557 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,559 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,561 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,563 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,565 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,567 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,569 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,572 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,574 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,576 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,578 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,581 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,583 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,585 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,587 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,589 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,591 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,593 copying lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,596 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,598 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,600 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,602 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,604 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,606 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,608 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,610 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,612 copying lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:15:37,614 copying lm_eval/tasks/ruler/niah_single_3.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,616 copying lm_eval/tasks/ruler/niah_multivalue.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,618 copying lm_eval/tasks/ruler/cwe.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,620 copying lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,621 copying lm_eval/tasks/ruler/vt.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,624 copying lm_eval/tasks/ruler/qa_squad.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,626 copying lm_eval/tasks/ruler/qa_hotpot.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,627 copying lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,630 copying lm_eval/tasks/ruler/fwe.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,631 copying lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,634 copying lm_eval/tasks/ruler/niah_single_1.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,636 copying lm_eval/tasks/ruler/niah_multiquery.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,638 copying lm_eval/tasks/ruler/ruler.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,640 copying lm_eval/tasks/ruler/niah_single_2.yaml -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:15:37,641 creating build/lib/lm_eval/tasks/openbookqa 2026-09-01T00:15:37,642 copying lm_eval/tasks/openbookqa/openbookqa.yaml -> build/lib/lm_eval/tasks/openbookqa 2026-09-01T00:15:37,645 creating build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,646 copying lm_eval/tasks/turblimp/island_effects.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,648 copying lm_eval/tasks/turblimp/binding.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,650 copying lm_eval/tasks/turblimp/passives.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,652 copying lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,654 copying lm_eval/tasks/turblimp/nominalization.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,656 copying lm_eval/tasks/turblimp/npi_licensing.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,658 copying lm_eval/tasks/turblimp/subject_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,660 copying lm_eval/tasks/turblimp/relative_clauses.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,663 copying lm_eval/tasks/turblimp/scrambling.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,665 copying lm_eval/tasks/turblimp/ellipsis.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,667 copying lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,669 copying lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,671 copying lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,674 copying lm_eval/tasks/turblimp/quantifiers.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,676 copying lm_eval/tasks/turblimp/irregular_forms.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,678 copying lm_eval/tasks/turblimp/turblimp_group.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,680 copying lm_eval/tasks/turblimp/determiners.yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:15:37,682 copying lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,685 copying lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,687 copying lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,689 copying lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,691 copying lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,693 copying lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,695 copying lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,697 copying lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,698 copying lm_eval/tasks/cabbq/cabbq.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,700 copying lm_eval/tasks/cabbq/cabbq_age.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,703 copying lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:15:37,705 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,707 copying lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,709 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,711 copying lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,713 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,715 copying lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,718 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,720 copying lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,722 copying lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,724 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,726 copying lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,728 copying lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,730 copying lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,733 copying lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,735 copying lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,737 copying lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,739 copying lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,741 copying lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,743 copying lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,746 copying lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,748 copying lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,750 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,752 copying lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,754 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,756 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,758 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,760 copying lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,762 copying lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,764 copying lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,766 copying lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,768 copying lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,770 copying lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:15:37,772 copying lm_eval/tasks/eq_bench/default.yaml -> build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:15:37,775 copying lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:15:37,777 copying lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/lib/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:15:37,779 copying lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,781 copying lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,783 copying lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,786 copying lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,788 copying lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,790 copying lm_eval/tasks/catalan_bench/teca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,792 copying lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,794 copying lm_eval/tasks/catalan_bench/catcola.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,797 copying lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,798 copying lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,801 copying lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,803 copying lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,805 copying lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,807 copying lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,810 copying lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,812 copying lm_eval/tasks/catalan_bench/coqcat.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,814 copying lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,816 copying lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,818 copying lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,820 copying lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,822 copying lm_eval/tasks/catalan_bench/terretaqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,824 copying lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,826 copying lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,828 copying lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:15:37,830 copying lm_eval/tasks/catalan_bench/cieacova/cieacova.yaml -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:15:37,832 copying lm_eval/tasks/catalan_bench/cieacova/cieacova_choice.yaml -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:15:37,834 copying lm_eval/tasks/catalan_bench/cieacova/cieacova_word.yaml -> build/lib/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:15:37,836 copying lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml -> build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:15:37,838 copying lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,840 copying lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,843 copying lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,845 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,847 copying lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,849 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,851 copying lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,853 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,855 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,857 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,860 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,862 copying lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,864 copying lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,866 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,868 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,871 copying lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,873 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:15:37,875 creating build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:15:37,876 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:15:37,878 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:15:37,880 copying lm_eval/tasks/babilong/babilong.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,883 copying lm_eval/tasks/babilong/babilong_qa11.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,885 copying lm_eval/tasks/babilong/babilong_qa7.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,887 copying lm_eval/tasks/babilong/babilong_qa16.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,889 copying lm_eval/tasks/babilong/babilong_qa15.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,891 copying lm_eval/tasks/babilong/babilong_longctx.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,893 copying lm_eval/tasks/babilong/babilong_qa13.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,895 copying lm_eval/tasks/babilong/babilong_qa3.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,897 copying lm_eval/tasks/babilong/babilong_qa12.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,899 copying lm_eval/tasks/babilong/babilong_qa20.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,901 copying lm_eval/tasks/babilong/babilong_qa8.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,903 copying lm_eval/tasks/babilong/babilong_qa19.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,906 copying lm_eval/tasks/babilong/babilong_qa10.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,908 copying lm_eval/tasks/babilong/babilong_qa18.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,910 copying lm_eval/tasks/babilong/babilong_qa5.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,912 copying lm_eval/tasks/babilong/babilong_qa4.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,914 copying lm_eval/tasks/babilong/babilong_qa6.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,916 copying lm_eval/tasks/babilong/babilong_qa9.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,919 copying lm_eval/tasks/babilong/babilong_qa17.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,921 copying lm_eval/tasks/babilong/babilong_qa2.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,923 copying lm_eval/tasks/babilong/babilong_qa1.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,925 copying lm_eval/tasks/babilong/babilong_qa14.yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:15:37,927 creating build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,928 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,931 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,933 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,935 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,937 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,940 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,942 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:15:37,944 copying lm_eval/tasks/csatqa/_csatqa.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,946 copying lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,948 copying lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,950 copying lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,952 copying lm_eval/tasks/csatqa/csatqa_li.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,954 copying lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,956 copying lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:15:37,958 creating build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,959 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,961 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,964 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,966 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,968 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,970 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,972 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,974 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,976 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,978 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,980 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:15:37,983 creating build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,984 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,986 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,988 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,990 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,992 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,994 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,996 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:37,999 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:38,001 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:38,003 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:38,005 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:15:38,007 creating build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,008 copying lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,010 copying lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,013 copying lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,015 copying lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,017 copying lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,019 copying lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,021 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,024 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,027 copying lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,029 copying lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,031 copying lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:15:38,033 copying lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:38,035 copying lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:38,037 copying lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:38,039 copying lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:15:38,041 copying lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,043 copying lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,045 copying lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,048 copying lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,050 copying lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,052 copying lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,054 copying lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,056 copying lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,058 copying lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,060 copying lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,062 copying lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,064 copying lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,067 copying lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,069 copying lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,071 copying lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,073 copying lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,075 copying lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,078 copying lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,080 copying lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,082 copying lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,084 copying lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,087 copying lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,089 copying lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,091 copying lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,093 copying lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,095 copying lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,097 copying lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,099 copying lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,102 copying lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,104 copying lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,106 copying lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,108 copying lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,110 copying lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,112 copying lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,114 copying lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,116 copying lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,118 copying lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,120 copying lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,122 copying lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,124 copying lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,126 copying lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,128 copying lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,130 copying lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,132 copying lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,134 copying lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,136 copying lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,138 copying lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,141 copying lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,143 copying lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,145 copying lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,147 copying lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,149 copying lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,151 copying lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,154 copying lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,156 copying lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,158 copying lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,160 copying lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,162 copying lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,164 copying lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,166 copying lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,168 copying lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,170 copying lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,172 copying lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,174 copying lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,177 copying lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,179 copying lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,181 copying lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,183 copying lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,185 copying lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,187 copying lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,189 copying lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,191 copying lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,193 copying lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,195 copying lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,197 copying lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,200 copying lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,202 copying lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,204 copying lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,206 copying lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,208 copying lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,210 copying lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,212 copying lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,214 copying lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,217 copying lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,219 copying lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,221 copying lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,223 copying lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,226 copying lm_eval/tasks/belebele/_belebele.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,228 copying lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,230 copying lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,232 copying lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,234 copying lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,237 copying lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,239 copying lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,241 copying lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,243 copying lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,246 copying lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,248 copying lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,250 copying lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,252 copying lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,254 copying lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,256 copying lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,258 copying lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,260 copying lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,262 copying lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,264 copying lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,266 copying lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,268 copying lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,270 copying lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,272 copying lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,274 copying lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,276 copying lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,278 copying lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,280 copying lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,283 copying lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,285 copying lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,287 copying lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,289 copying lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,291 copying lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,293 copying lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,295 copying lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,298 copying lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,300 copying lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:15:38,302 copying lm_eval/tasks/paws-x/paws_de.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,305 copying lm_eval/tasks/paws-x/_pawsx.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,307 copying lm_eval/tasks/paws-x/paws_ja.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,309 copying lm_eval/tasks/paws-x/paws_es.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,311 copying lm_eval/tasks/paws-x/paws_ko.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,313 copying lm_eval/tasks/paws-x/paws_en.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,315 copying lm_eval/tasks/paws-x/paws_zh.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,317 copying lm_eval/tasks/paws-x/paws_fr.yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:15:38,320 copying lm_eval/tasks/copal_id/standard.yaml -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:15:38,322 copying lm_eval/tasks/copal_id/colloquial.yaml -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:15:38,324 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:15:38,324 copying lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:15:38,327 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,328 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,330 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,332 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,334 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,336 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,338 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,340 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,342 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,344 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,347 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,349 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,351 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,353 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,355 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,358 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,360 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,362 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,364 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,367 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:15:38,369 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,370 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,372 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,374 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,377 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,379 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,381 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,383 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,386 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,388 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,390 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,392 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,394 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,396 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,398 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,401 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,403 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,405 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,407 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,410 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:15:38,412 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,413 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,415 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,417 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,420 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,422 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,424 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,427 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,429 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,431 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,433 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,436 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,438 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,440 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,442 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,445 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,447 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,449 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,451 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,453 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:15:38,456 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,457 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,459 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,461 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,463 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,466 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,468 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,470 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,472 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,474 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,477 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,479 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,481 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,483 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,486 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,488 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,490 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,493 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,495 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,498 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:15:38,500 creating build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,501 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,503 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,506 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,508 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,510 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,513 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,516 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,518 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,520 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,522 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,524 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,526 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,529 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,531 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,533 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,536 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,538 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,540 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,542 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:15:38,545 creating build/lib/lm_eval/tasks/afrimgsm/translate 2026-09-01T00:15:38,546 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2026-09-01T00:15:38,548 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,549 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,551 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,554 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,556 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,559 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,561 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,563 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,565 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,567 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,569 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,572 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,574 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,576 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,578 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,580 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,582 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,584 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:15:38,587 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,588 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,590 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,592 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,594 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,597 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,599 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,601 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,603 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,606 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,608 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,610 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,613 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,615 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,617 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,619 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,621 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,623 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:15:38,625 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,626 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,629 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,631 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,633 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,635 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,637 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,640 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,642 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,644 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,646 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,649 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,651 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,653 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,656 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,658 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,661 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,663 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:15:38,665 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,666 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,669 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,671 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,673 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,676 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,678 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,680 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,683 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,685 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,687 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,689 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,691 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,693 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,695 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,698 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,700 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,702 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:15:38,704 creating build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,705 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,708 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,710 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,712 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,714 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,716 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,719 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,721 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,723 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,725 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,728 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,730 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,732 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,734 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,737 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,739 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,741 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:15:38,743 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:15:38,744 copying lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:15:38,746 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,747 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,750 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,752 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,754 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,757 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,759 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,761 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,763 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,766 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,768 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,770 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,772 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,774 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,777 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,779 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,781 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,784 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,786 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:15:38,788 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,789 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,791 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,793 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,796 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,798 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,800 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,802 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,804 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,807 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,809 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,811 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,814 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,816 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,818 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,820 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,822 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,825 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,827 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:15:38,829 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,830 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,833 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,835 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,837 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,839 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,841 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,843 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,846 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,848 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,850 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,852 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,854 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,856 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,859 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,861 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,863 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,866 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,868 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:15:38,870 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,871 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,874 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,876 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,879 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,881 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,883 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,886 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,888 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,890 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,893 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,895 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,897 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,899 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,902 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,904 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,906 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,909 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,911 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:15:38,913 creating build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,914 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,916 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,918 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,921 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,923 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,925 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,927 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,930 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,932 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,934 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,937 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,939 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,942 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,944 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,947 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,949 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,951 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,953 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:15:38,956 creating build/lib/lm_eval/tasks/afrimgsm/direct 2026-09-01T00:15:38,957 copying lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2026-09-01T00:15:38,959 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,960 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,963 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,965 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,967 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,970 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,972 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,974 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,977 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,979 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,981 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,983 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,986 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,988 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,990 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,992 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,994 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,996 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:38,999 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:39,001 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:15:39,003 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,004 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,006 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,009 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,011 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,013 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,015 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,017 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,019 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,021 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,023 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,025 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,027 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,030 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,032 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,034 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,036 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,038 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,041 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,043 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:15:39,045 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,046 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,048 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,050 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,053 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,055 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,057 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,059 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,061 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,063 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,065 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,068 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,070 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,072 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,074 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,076 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,078 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,081 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,083 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,085 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:15:39,087 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,088 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,090 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,093 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,095 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,097 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,099 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,102 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,104 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,106 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,108 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,110 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,113 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,115 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,117 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,119 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,121 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,124 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,126 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,128 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:15:39,130 creating build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,132 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,134 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,136 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,138 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,140 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,143 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,145 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,147 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,149 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,151 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,153 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,155 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,157 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,159 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,161 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,163 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,165 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,167 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,169 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:15:39,171 copying lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,173 copying lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,175 copying lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,177 copying lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,180 copying lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,182 copying lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,184 copying lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,186 copying lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,188 copying lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,190 copying lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,193 copying lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,195 copying lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,197 copying lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,199 copying lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,201 copying lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,203 copying lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,205 copying lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,207 copying lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,209 copying lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,212 copying lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,214 copying lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,216 copying lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,218 copying lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,220 copying lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,222 copying lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,224 copying lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,226 copying lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,228 copying lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,230 copying lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,232 copying lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,234 copying lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,237 copying lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,239 copying lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,241 copying lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,243 copying lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,245 copying lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,247 copying lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,249 copying lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,252 copying lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,254 copying lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,256 copying lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,258 copying lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,260 copying lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,262 copying lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,264 copying lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,266 copying lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,268 copying lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,270 copying lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,272 copying lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:15:39,274 copying lm_eval/tasks/pisa/pisa_es.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,276 copying lm_eval/tasks/pisa/pisa_fr.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,278 copying lm_eval/tasks/pisa/pisa_it.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,280 copying lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,282 copying lm_eval/tasks/pisa/pisa_de.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,284 copying lm_eval/tasks/pisa/pisa_en_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,287 copying lm_eval/tasks/pisa/pisa_es_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,289 copying lm_eval/tasks/pisa/_pisa_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,291 copying lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,293 copying lm_eval/tasks/pisa/pisa_en.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,294 copying lm_eval/tasks/pisa/_pisa.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,296 copying lm_eval/tasks/pisa/pisa_ch.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,298 copying lm_eval/tasks/pisa/pisa_it_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,300 copying lm_eval/tasks/pisa/pisa_de_llm_judged.yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:15:39,302 copying lm_eval/tasks/click/click.yaml -> build/lib/lm_eval/tasks/click 2026-09-01T00:15:39,304 copying lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:15:39,307 copying lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:15:39,309 copying lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:15:39,311 copying lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:15:39,313 copying lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,315 copying lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,317 copying lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,319 copying lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,321 copying lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,323 copying lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,325 copying lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,327 copying lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,329 copying lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:15:39,331 copying lm_eval/tasks/winogender/winogender.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,333 copying lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,335 copying lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,338 copying lm_eval/tasks/winogender/winogender_female.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,340 copying lm_eval/tasks/winogender/winogender_neutral.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,342 copying lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,344 copying lm_eval/tasks/winogender/winogender_male.yaml -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:15:39,346 copying lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:15:39,348 copying lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/lib/lm_eval/tasks/med_prescriptions 2026-09-01T00:15:39,350 copying lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:39,352 copying lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:39,355 copying lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:39,357 copying lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:39,359 copying lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:39,361 copying lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:15:39,363 copying lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:39,365 copying lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:39,367 copying lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:39,369 copying lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:39,371 copying lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:39,373 copying lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:15:39,375 creating build/lib/lm_eval/tasks/indicxnli 2026-09-01T00:15:39,376 copying lm_eval/tasks/indicxnli/indicxnli_gu.yaml -> build/lib/lm_eval/tasks/indicxnli 2026-09-01T00:15:39,378 creating build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,379 copying lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,381 copying lm_eval/tasks/xstorycloze/default_ru.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,383 copying lm_eval/tasks/xstorycloze/default_en.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,385 copying lm_eval/tasks/xstorycloze/default_hi.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,387 copying lm_eval/tasks/xstorycloze/default_sw.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,390 copying lm_eval/tasks/xstorycloze/default_ar.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,392 copying lm_eval/tasks/xstorycloze/default_my.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,394 copying lm_eval/tasks/xstorycloze/default_te.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,396 copying lm_eval/tasks/xstorycloze/default_es.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,398 copying lm_eval/tasks/xstorycloze/default_eu.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,400 copying lm_eval/tasks/xstorycloze/default_zh.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,402 copying lm_eval/tasks/xstorycloze/default_id.yaml -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:15:39,404 copying lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:15:39,406 creating build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:15:39,407 copying lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:15:39,409 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:15:39,410 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:15:39,412 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:15:39,414 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:15:39,417 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:15:39,419 copying lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:15:39,421 creating build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:15:39,422 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:15:39,424 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:15:39,426 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:15:39,428 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:15:39,430 copying lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:15:39,432 creating build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,433 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,435 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,437 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,439 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,440 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,443 copying lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:15:39,444 creating build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,445 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,448 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,450 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,452 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,454 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,456 copying lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:15:39,458 creating build/lib/lm_eval/tasks/noreval/ncb 2026-09-01T00:15:39,459 copying lm_eval/tasks/noreval/ncb/ncb.yaml -> build/lib/lm_eval/tasks/noreval/ncb 2026-09-01T00:15:39,461 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:15:39,463 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:15:39,465 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:15:39,467 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:15:39,469 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:15:39,471 copying lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:15:39,473 creating build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:15:39,474 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:15:39,476 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:15:39,478 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:15:39,480 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:15:39,483 copying lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:15:39,485 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:15:39,486 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:15:39,488 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:15:39,490 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:15:39,492 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:15:39,494 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:15:39,496 creating build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:15:39,497 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:15:39,500 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:15:39,502 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:15:39,504 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:15:39,506 copying lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:15:39,508 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:39,510 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:39,513 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:39,514 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:39,517 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:15:39,519 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:39,521 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:39,523 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:39,526 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:39,528 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:15:39,530 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:15:39,532 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:15:39,534 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:15:39,536 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:15:39,538 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:15:39,540 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:15:39,541 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:15:39,543 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:15:39,545 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:15:39,548 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:15:39,550 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:15:39,551 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:15:39,553 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:15:39,555 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:15:39,557 copying lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:15:39,559 creating build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:15:39,560 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:15:39,563 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:15:39,565 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:15:39,567 copying lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:15:39,569 creating build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:15:39,570 copying lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/lib/lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:15:39,573 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:39,575 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:39,577 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:39,580 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:39,582 copying lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:15:39,584 creating build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:15:39,585 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:15:39,587 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:15:39,589 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:15:39,591 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:15:39,594 copying lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:15:39,596 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:39,598 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:39,600 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:39,602 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:39,604 copying lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:15:39,606 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:39,608 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:39,610 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:39,612 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:39,614 copying lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:15:39,616 copying lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:39,618 copying lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:39,621 copying lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:39,623 copying lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:39,625 copying lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:15:39,627 creating build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:15:39,628 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:15:39,630 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:15:39,632 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:15:39,634 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:15:39,636 copying lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:15:39,638 creating build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:15:39,639 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:15:39,642 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:15:39,644 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:15:39,646 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:15:39,648 copying lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/lib/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:15:39,650 creating build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:15:39,651 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:15:39,653 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:15:39,655 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:15:39,657 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:15:39,659 copying lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:15:39,661 creating build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:15:39,662 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:15:39,665 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:15:39,667 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:15:39,669 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:15:39,671 copying lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/lib/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:15:39,673 copying lm_eval/tasks/fda/fda.yaml -> build/lib/lm_eval/tasks/fda 2026-09-01T00:15:39,675 creating build/lib/lm_eval/tasks/bear 2026-09-01T00:15:39,676 copying lm_eval/tasks/bear/bear_big.yaml -> build/lib/lm_eval/tasks/bear 2026-09-01T00:15:39,678 copying lm_eval/tasks/bear/bear.yaml -> build/lib/lm_eval/tasks/bear 2026-09-01T00:15:39,680 creating build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:15:39,681 copying lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:15:39,683 copying lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:15:39,685 creating build/lib/lm_eval/tasks/babi 2026-09-01T00:15:39,686 copying lm_eval/tasks/babi/babi.yaml -> build/lib/lm_eval/tasks/babi 2026-09-01T00:15:39,688 creating build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,689 copying lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,691 copying lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,693 copying lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,696 copying lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,698 copying lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,700 copying lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:15:39,702 copying lm_eval/tasks/xquad/xquad_th.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,704 copying lm_eval/tasks/xquad/xquad_ru.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,706 copying lm_eval/tasks/xquad/xquad_de.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,708 copying lm_eval/tasks/xquad/xquad_ar.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,710 copying lm_eval/tasks/xquad/xquad_vi.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,712 copying lm_eval/tasks/xquad/xquad_ro.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,714 copying lm_eval/tasks/xquad/xquad_zh.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,716 copying lm_eval/tasks/xquad/xquad_en.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,718 copying lm_eval/tasks/xquad/xquad_el.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,720 copying lm_eval/tasks/xquad/xquad_tr.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,722 copying lm_eval/tasks/xquad/xquad_es.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,724 copying lm_eval/tasks/xquad/xquad_hi.yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:15:39,727 copying lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/lib/lm_eval/tasks/afrixnli/translate 2026-09-01T00:15:39,729 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,731 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,733 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,735 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,737 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,739 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,741 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,743 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,746 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,748 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,750 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,752 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,754 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,757 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,759 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,761 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,763 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:15:39,765 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,767 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,769 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,771 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,774 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,776 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,778 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,780 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,782 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,784 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,786 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,788 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,790 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,792 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,794 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,796 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,798 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:15:39,801 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,803 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,805 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,807 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,809 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,812 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,814 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,816 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,818 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,820 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,822 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,824 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,826 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,829 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,831 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,833 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,835 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:15:39,838 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,840 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,842 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,844 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,846 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,848 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,850 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,852 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,854 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,856 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,858 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,860 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,862 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,865 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,867 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,869 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,871 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:15:39,873 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,875 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,878 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,880 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,882 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,884 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,886 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,889 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,891 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,893 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,895 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,897 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,899 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,901 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,903 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,905 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,908 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:15:39,910 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,912 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,914 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,916 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,918 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,920 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,922 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,924 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,927 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,929 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,931 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,933 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,935 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,938 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,940 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,942 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,944 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:15:39,946 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,948 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,950 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,952 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,954 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,956 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,959 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,961 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,963 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,965 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,968 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,970 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,972 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,974 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,977 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,979 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,981 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,984 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:15:39,986 copying lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/lib/lm_eval/tasks/afrixnli/direct 2026-09-01T00:15:39,989 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:39,991 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:39,993 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:39,995 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:39,998 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,000 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,002 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,004 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,007 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,009 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,011 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,013 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,015 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,017 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,020 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,022 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,024 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,026 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:15:40,028 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,031 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,033 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,035 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,037 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,039 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,042 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,044 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,046 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,048 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,050 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,053 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,055 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,057 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,059 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,061 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,063 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,066 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:15:40,068 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,070 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,072 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,074 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,076 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,078 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,080 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,083 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,085 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,087 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,089 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,091 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,093 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,095 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,098 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,100 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,102 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,104 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:15:40,106 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,108 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,111 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,113 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,115 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,117 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,119 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,121 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,123 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,125 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,127 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,129 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,131 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,133 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,135 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,138 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,140 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,142 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:15:40,144 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,146 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,148 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,150 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,152 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,154 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,157 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,159 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,161 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,163 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,165 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,167 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,170 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,172 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,174 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,176 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,179 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,181 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:15:40,183 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,185 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,188 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,190 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,192 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,194 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,196 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,199 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,201 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,203 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,205 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,208 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,210 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,212 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,215 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,217 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,219 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,222 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:15:40,224 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,226 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,228 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,230 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,233 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,235 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,237 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,239 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,241 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,243 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,246 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,248 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,250 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,252 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,254 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,256 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,258 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,261 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:15:40,263 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,265 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,267 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,269 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,271 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,274 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,276 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,278 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,281 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,283 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,285 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,287 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,289 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,292 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,294 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,296 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,298 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:15:40,300 copying lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,302 copying lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,304 copying lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,306 copying lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,309 copying lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,311 copying lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,313 copying lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,315 copying lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,318 copying lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,320 copying lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,322 copying lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,324 copying lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,326 copying lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,329 copying lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,331 copying lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,333 copying lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,336 copying lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,338 copying lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:15:40,340 copying lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:15:40,342 creating build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,343 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,345 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,348 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,350 copying lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,353 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,355 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,357 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,359 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,362 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,364 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,366 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,369 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,371 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,374 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,377 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,379 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,381 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,383 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,385 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,388 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,390 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,392 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,394 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,396 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,399 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,401 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,403 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,405 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,408 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,410 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,412 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,414 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,416 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,418 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,421 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,423 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,425 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,427 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,429 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,432 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,434 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,436 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,438 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,440 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,443 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,445 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,447 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,449 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,451 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,453 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,456 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,458 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,460 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,462 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,464 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,466 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,469 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,471 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,473 copying lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,475 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,477 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,480 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,482 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,484 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,486 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,488 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,491 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,493 copying lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,495 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,497 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,500 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,502 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,504 copying lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:15:40,506 copying lm_eval/tasks/agieval/logiqa-en.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,508 copying lm_eval/tasks/agieval/sat-en.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,510 copying lm_eval/tasks/agieval/agieval_nous.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,513 copying lm_eval/tasks/agieval/agieval.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,515 copying lm_eval/tasks/agieval/lsat-ar.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,517 copying lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,519 copying lm_eval/tasks/agieval/aqua-rat.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,522 copying lm_eval/tasks/agieval/math.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,524 copying lm_eval/tasks/agieval/agieval_cn.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,526 copying lm_eval/tasks/agieval/gaokao-biology.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,528 copying lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,530 copying lm_eval/tasks/agieval/lsat-rc.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,532 copying lm_eval/tasks/agieval/gaokao-physics.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,534 copying lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,537 copying lm_eval/tasks/agieval/gaokao-geography.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,543 copying lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,556 copying lm_eval/tasks/agieval/agieval_en.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,561 copying lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,563 copying lm_eval/tasks/agieval/logiqa-zh.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,565 copying lm_eval/tasks/agieval/gaokao-english.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,567 copying lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,569 copying lm_eval/tasks/agieval/sat-math.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,571 copying lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,573 copying lm_eval/tasks/agieval/gaokao-history.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,575 copying lm_eval/tasks/agieval/lsat-lr.yaml -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:15:40,577 creating build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,578 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,580 copying lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,583 copying lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,585 copying lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,587 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,589 copying lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,592 copying lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,594 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,596 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,598 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,600 copying lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,603 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,605 copying lm_eval/tasks/zhoblimp/you_yige.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,607 copying lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,609 copying lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,612 copying lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,614 copying lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,616 copying lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,618 copying lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,621 copying lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,623 copying lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,625 copying lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,627 copying lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,630 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,632 copying lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,634 copying lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,636 copying lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,638 copying lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,641 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,643 copying lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,645 copying lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,647 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,649 copying lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,652 copying lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,654 copying lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,656 copying lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,658 copying lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,661 copying lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,663 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,665 copying lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,667 copying lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,669 copying lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,672 copying lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,674 copying lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,676 copying lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,678 copying lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,681 copying lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,683 copying lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,685 copying lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,687 copying lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,690 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,692 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,694 copying lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,697 copying lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,699 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,701 copying lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,703 copying lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,706 copying lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,707 copying lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,709 copying lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,712 copying lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,714 copying lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,716 copying lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,718 copying lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,720 copying lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,722 copying lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,724 copying lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,726 copying lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,728 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,730 copying lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,733 copying lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,735 copying lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,737 copying lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,739 copying lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,741 copying lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,743 copying lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,746 copying lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,748 copying lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,751 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,753 copying lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,755 copying lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,757 copying lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,759 copying lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,761 copying lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,764 copying lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,766 copying lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,768 copying lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,770 copying lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,772 copying lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,774 copying lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,777 copying lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,779 copying lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,781 copying lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,783 copying lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,785 copying lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,787 copying lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,789 copying lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,791 copying lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,793 copying lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,796 copying lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,798 copying lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,800 copying lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,802 copying lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,804 copying lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,806 copying lm_eval/tasks/zhoblimp/left_dou.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,809 copying lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,811 copying lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,813 copying lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,816 copying lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,818 copying lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,820 copying lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,822 copying lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,824 copying lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,826 copying lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,829 copying lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,831 copying lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,833 copying lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,835 copying lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,837 copying lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:15:40,839 copying lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:15:40,842 copying lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:15:40,844 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,846 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,848 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,850 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,852 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,854 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,856 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,858 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,860 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,862 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,864 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,866 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,868 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,870 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,872 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,874 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,877 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,879 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,881 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,883 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,885 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:15:40,887 creating build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,888 copying lm_eval/tasks/bhs/bhs_basque.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,891 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,893 copying lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,895 copying lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,897 copying lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,899 copying lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,901 copying lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,903 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,905 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,907 copying lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,910 copying lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,912 copying lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,914 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,916 copying lm_eval/tasks/bhs/bhs_hindi.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,918 copying lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,920 copying lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,922 copying lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,924 copying lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,926 copying lm_eval/tasks/bhs/bhs_swahili.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,928 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,930 copying lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,932 copying lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,934 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,936 copying lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,939 copying lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:15:40,941 copying lm_eval/tasks/toksuite/_toksuite_all.yaml -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:15:40,943 copying lm_eval/tasks/toksuite/_toksuite_abridged.yaml -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:15:40,945 creating build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,946 copying lm_eval/tasks/toksuite/toksuite_chinese/_toksuite_chinese.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,948 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_romanization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,951 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,953 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,955 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,957 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_partially_romanized.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,960 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,962 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_traditional.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,964 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_ocr_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,966 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,969 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,971 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,973 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_optional_diacritics.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,975 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_word_spacing_zero-width_characters_extra_space.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,977 copying lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:15:40,979 creating build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,980 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,982 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,984 copying lm_eval/tasks/toksuite/toksuite_turkish/_toksuite_turkish.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,986 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,988 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_dialects.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,990 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_derivations.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,992 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_inflections.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,994 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_similar_words.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,996 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:40,998 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_orthographic_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,000 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_english_keyboard.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,002 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_web_search_query.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,004 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,007 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_typographical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,009 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,011 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,013 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_date_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,015 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_grammatical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,017 copying lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_word_reordering.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:15:41,019 creating build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,020 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spaced_styling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,023 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_macron_diacritic.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,025 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_lowercase.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,027 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_emoji_substitution.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,029 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_deletion.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,031 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,033 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_word_reordering.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,035 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_substitution.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,037 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,039 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_date_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,041 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_capitalization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,043 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_contractions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,045 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_ocr_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,047 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,050 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,052 copying lm_eval/tasks/toksuite/toksuite_english/_toksuite_english.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,054 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_web_search_query.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,056 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_scripted_text.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,058 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_grammatical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,061 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_letter_repetition_for_emphasis.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,063 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_historical_spelling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,065 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_inflections.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,067 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_similar_words.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,069 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_hyphenated_spelling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,071 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_homoglyphs.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,073 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,076 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_compounds.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,078 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_superscript_subscript_styling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,080 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_abbreviations.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,082 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_orthographic_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,084 copying lm_eval/tasks/toksuite/toksuite_english/toksuite_english_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:15:41,086 creating build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,087 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_romanization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,089 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,091 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,093 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,096 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,098 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_word_spacing_zero-width_characters_extra_space.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,100 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,102 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_dialects.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,104 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_number_romanization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,106 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,109 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_optional_diacritics.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,111 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_arabic_keyboard_for_farsi.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,113 copying lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,115 copying lm_eval/tasks/toksuite/toksuite_farsi/_toksuite_farsi.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:15:41,117 creating build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,118 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_latex.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,121 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,123 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_farsi.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,125 copying lm_eval/tasks/toksuite/toksuite_math/_toksuite_math.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,127 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_turkish.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,130 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,132 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,134 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_decorative_unicode.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,136 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_italian.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,138 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_chinese.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,140 copying lm_eval/tasks/toksuite/toksuite_math/toksuite_math_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:15:41,142 creating build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,143 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,145 copying lm_eval/tasks/toksuite/toksuite_italian/_toksuite_italian.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,147 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_capitalization.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,149 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_code_language_script_switching.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,151 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_plausible_diacritics_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,153 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_numerical_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,155 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_phonetic_spelling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,157 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_similar_words.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,159 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_contractions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,161 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_keyboard_proximity_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,163 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_date_formats.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,165 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_grammatical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,167 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_orthographic_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,170 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_dialects.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,172 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_web_search_query.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,174 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_english_keyboard.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,176 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_typographical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,178 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,180 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,183 copying lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_abbreviations.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:15:41,184 creating build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,186 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_diacriticized_styling.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,188 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_latex.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,190 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_upside_down_rotated.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,192 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_colloquial.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,194 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_enclosed_characters.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,196 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_spelled_out.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,198 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_double_struck.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,200 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unusual_formatting.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,202 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_base.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,204 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_strikethrough.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,206 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_morpheme_separation.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,209 copying lm_eval/tasks/toksuite/toksuite_stem/_toksuite_stem.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,211 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_space_removal.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,213 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_fullwidth_characters.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,215 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_superscript_subscript.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,217 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unicode_formatting.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,220 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_typographical_errors.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,222 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_character_deletion.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,224 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_equivalent_expressions.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,226 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_scripted_text.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,228 copying lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_canonical.yaml -> build/lib/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:15:41,231 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,233 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,235 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,237 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,239 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,241 copying lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,244 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,246 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,248 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,250 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,252 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,254 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,257 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,259 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,261 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,263 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,265 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,267 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,269 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,271 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,273 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,275 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,277 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,280 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,282 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,284 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,286 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,288 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,290 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,293 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,295 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,297 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,299 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,301 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,303 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,306 copying lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,308 copying lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,310 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,312 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,314 copying lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,316 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,318 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,320 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,322 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,324 copying lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,326 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,328 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,330 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,332 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,334 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,336 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,338 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,340 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,342 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,344 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,346 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,348 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,351 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,353 copying lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,355 copying lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,357 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,359 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,361 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,363 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,365 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,367 copying lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,369 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,371 copying lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,374 copying lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,376 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,378 copying lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,380 copying lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,382 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:15:41,384 copying lm_eval/tasks/infinitebench/infinitebench_math_find.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,386 copying lm_eval/tasks/infinitebench/infinitebench_longbook_qa_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,389 copying lm_eval/tasks/infinitebench/infinitebench_longbook_sum_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,391 copying lm_eval/tasks/infinitebench/infinitebench_code_debug.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,393 copying lm_eval/tasks/infinitebench/infinitebench_longbook_choice_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,395 copying lm_eval/tasks/infinitebench/infinitebench_kv_retrieval.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,397 copying lm_eval/tasks/infinitebench/infinitebench_passkey.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,399 copying lm_eval/tasks/infinitebench/infinitebench_longbook_qa_chn.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,401 copying lm_eval/tasks/infinitebench/infinitebench_code_run.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,403 copying lm_eval/tasks/infinitebench/infinitebench.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,405 copying lm_eval/tasks/infinitebench/infinitebench_number_string.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,407 copying lm_eval/tasks/infinitebench/infinitebench_longdialogue_qa_en.yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:15:41,409 copying lm_eval/tasks/wsc273/default.yaml -> build/lib/lm_eval/tasks/wsc273 2026-09-01T00:15:41,411 copying lm_eval/tasks/logiqa/logiqa.yaml -> build/lib/lm_eval/tasks/logiqa 2026-09-01T00:15:41,413 copying lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,415 copying lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,417 copying lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,419 copying lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,422 copying lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,424 copying lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,426 copying lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:15:41,428 copying lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:15:41,430 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:15:41,432 copying lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:15:41,434 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,437 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,439 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,441 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,443 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,445 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,447 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,449 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,451 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,453 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,455 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,457 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,459 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,461 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,463 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:15:41,466 copying lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:15:41,468 copying lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:15:41,470 copying lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:15:41,472 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:15:41,474 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:15:41,476 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:15:41,478 copying lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:15:41,480 copying lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:15:41,482 copying lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:15:41,485 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:15:41,487 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:15:41,489 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:15:41,491 copying lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:15:41,493 copying lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:15:41,496 copying lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:15:41,498 copying lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,501 copying lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,503 copying lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,505 copying lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,507 copying lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,509 copying lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,511 copying lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:15:41,513 copying lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,516 copying lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,518 copying lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,520 copying lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,522 copying lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,524 copying lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,526 copying lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,528 copying lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,531 copying lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:15:41,533 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,535 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,537 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,539 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,541 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,543 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,546 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,548 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,550 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,552 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,554 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,557 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,559 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,561 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,563 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,566 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,568 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,570 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,572 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,574 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,577 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,579 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,581 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,583 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,585 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,588 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,590 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,592 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,594 copying lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,596 copying lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:15:41,598 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,600 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,603 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,605 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,607 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,609 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,611 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,613 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,615 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,617 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,619 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,621 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,623 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,626 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,628 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,630 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,632 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,634 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,637 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,639 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,641 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,643 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,645 copying lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,647 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,650 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,652 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,654 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,656 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,658 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,660 copying lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:15:41,662 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,664 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,666 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,668 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,671 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,672 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,674 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,677 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,679 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,681 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,683 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,685 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,687 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,689 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,692 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,694 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,696 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,698 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,700 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,702 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,704 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,707 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,709 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,711 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,714 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,716 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,718 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,720 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,722 copying lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,724 copying lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:15:41,726 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,729 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,731 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,733 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,735 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,737 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,739 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,741 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,743 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,745 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,748 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,750 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,752 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,754 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,756 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,758 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,761 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,763 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,765 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,767 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,769 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,771 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,773 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,776 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,778 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,780 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,782 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,784 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,786 copying lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,789 copying lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:15:41,791 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,793 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,795 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,797 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,799 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,801 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,803 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,805 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,807 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,809 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,811 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,813 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,816 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,818 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,820 copying lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,822 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,824 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,826 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,828 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,830 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,832 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,834 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,837 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,839 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,841 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,843 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,845 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,847 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,850 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,852 copying lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:15:41,854 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,856 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,858 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,860 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,862 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,864 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,867 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,869 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,871 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,873 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,875 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,877 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,879 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,881 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,883 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,885 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,887 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,889 copying lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,891 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,893 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,895 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,897 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,899 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,902 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,904 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,906 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,908 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,910 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,912 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,914 copying lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:15:41,916 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,919 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,921 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,923 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,925 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,927 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,930 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,931 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,934 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,936 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,938 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,940 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,942 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,944 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,946 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,948 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,950 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,952 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,954 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,957 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,959 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,961 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,963 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,965 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,967 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,970 copying lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,972 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,974 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,976 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,978 copying lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:15:41,980 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,982 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,984 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,987 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,989 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,991 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,993 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,995 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,997 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:41,999 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,001 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,003 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,005 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,007 copying lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,009 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,011 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,013 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,015 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,017 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,019 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,021 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,024 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,026 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,028 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,030 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,032 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,034 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,036 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,038 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,040 copying lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:15:42,042 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,044 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,047 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,049 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,051 copying lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,053 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,055 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,057 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,059 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,061 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,063 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,065 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,067 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,069 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,071 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,073 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,075 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,077 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,079 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,081 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,084 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,086 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,088 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,090 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,092 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,094 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,096 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,098 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,100 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,102 copying lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:15:42,105 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,107 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,109 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,111 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,113 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,115 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,117 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,119 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,121 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,123 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,125 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,127 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,129 copying lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,131 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,133 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,135 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,137 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,139 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,141 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,143 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,145 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,147 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,149 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,151 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,153 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,155 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,158 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,160 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,162 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,164 copying lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:15:42,166 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,168 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,170 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,172 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,174 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,176 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,178 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,180 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,182 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,185 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,187 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,189 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,191 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,193 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,195 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,197 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,199 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,201 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,203 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,206 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,208 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,210 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,212 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,214 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,216 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,218 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,221 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,223 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,225 copying lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,227 copying lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:15:42,229 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,231 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,233 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,236 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,238 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,240 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,242 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,244 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,246 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,248 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,250 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,252 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,254 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,256 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,258 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,260 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,262 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,264 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,266 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,268 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,270 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,273 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,275 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,277 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,279 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,281 copying lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,283 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,285 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,287 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,289 copying lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:15:42,291 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,294 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,296 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,298 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,300 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,302 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,304 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,306 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,308 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,310 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,312 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,315 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,317 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,319 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,321 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,323 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,324 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,326 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,328 copying lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,330 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,332 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,334 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,337 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,339 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,341 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,343 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,345 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,347 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,349 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,351 copying lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:15:42,353 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,355 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,357 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,359 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,361 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,363 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,365 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,367 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,369 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,371 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,373 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,376 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,378 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,380 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,382 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,384 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,386 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,388 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,390 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,392 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,394 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,396 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,398 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,399 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,401 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,403 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,406 copying lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,408 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,410 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,412 copying lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:15:42,414 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,416 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,418 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,420 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,422 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,424 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,427 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,429 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,431 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,433 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,435 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,437 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,439 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,441 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,443 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,445 copying lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,447 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,449 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,451 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,453 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,455 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,458 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,460 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,462 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,464 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,466 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,468 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,470 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,472 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,474 copying lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:15:42,476 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,478 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,480 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,482 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,484 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,487 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,489 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,491 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,493 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,495 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,497 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,499 copying lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,502 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,504 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,506 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,508 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,510 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,512 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,514 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,516 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,518 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,520 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,522 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,524 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,526 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,528 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,530 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,532 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,534 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,536 copying lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:15:42,538 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,540 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,542 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,544 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,546 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,548 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,550 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,552 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,554 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,556 copying lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,558 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,560 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,562 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,564 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,566 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,568 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,570 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,572 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,574 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,576 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,579 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,581 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,583 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,585 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,587 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,589 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,591 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,593 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,596 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,598 copying lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:15:42,600 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,602 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,604 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,606 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,608 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,611 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,613 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,615 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,617 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,620 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,622 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,624 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,626 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,629 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,631 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,633 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,635 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,638 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,640 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,642 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,644 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,646 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,648 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,650 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,652 copying lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,655 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,657 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,659 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,661 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,663 copying lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:15:42,665 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,667 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,669 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,671 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,673 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,676 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,678 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,680 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,682 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,684 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,686 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,688 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,690 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,693 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,695 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,698 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,700 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,702 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,704 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,706 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,709 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,711 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,713 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,715 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,717 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,719 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,722 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,724 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,726 copying lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,728 copying lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:15:42,730 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,733 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,735 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,737 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,740 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,742 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,744 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,746 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,748 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,751 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,753 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,755 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,757 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,760 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,762 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,764 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,766 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,768 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,771 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,774 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,776 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,778 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,781 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,783 copying lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,785 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,787 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,789 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,792 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,794 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,796 copying lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:15:42,799 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,801 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,803 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,805 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,808 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,810 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,812 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,814 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,816 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,819 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,821 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,823 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,826 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,828 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,830 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,832 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,835 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,837 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,839 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,841 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,843 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,846 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,848 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,850 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,852 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,854 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,857 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,859 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,861 copying lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,863 copying lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:15:42,865 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,867 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,869 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,871 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,873 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,876 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,878 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,880 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,882 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,884 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,886 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,888 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,890 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,893 copying lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,895 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,897 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,899 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,901 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,903 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,905 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,907 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,910 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,912 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,914 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,916 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,918 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,920 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,922 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,925 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,927 copying lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:15:42,929 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,931 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,933 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,935 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,937 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,939 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,941 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,943 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,945 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,947 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,949 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,952 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,954 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,956 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,958 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,960 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,962 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,964 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,967 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,969 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,971 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,973 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,976 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,978 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,980 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,982 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,984 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,987 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,989 copying lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,991 copying lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:15:42,993 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:42,995 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:42,997 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:42,999 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,001 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,003 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,006 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,008 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,010 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,012 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,014 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,016 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,018 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,020 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,022 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,025 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,027 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,029 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,031 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,033 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,036 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,038 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,040 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,042 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,044 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,047 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,049 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,051 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,053 copying lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,055 copying lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:15:43,057 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,059 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,061 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,063 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,065 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,067 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,069 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,071 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,074 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,076 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,078 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,080 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,082 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,084 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,087 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,089 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,091 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,093 copying lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,095 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,097 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,100 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,102 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,104 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,106 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,108 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,111 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,113 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,115 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,117 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,119 copying lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:15:43,122 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,124 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,126 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,128 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,130 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,132 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,134 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,136 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,138 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,140 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,142 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,144 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,146 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,148 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,150 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,152 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,154 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,157 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,159 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,161 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,163 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,165 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,167 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,169 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,171 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,173 copying lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,175 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,177 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,179 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,182 copying lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:15:43,184 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,186 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,188 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,190 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,192 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,194 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,196 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,198 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,200 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,202 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,204 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,207 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,209 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,211 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,213 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,215 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,217 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,219 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,222 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,224 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,226 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,228 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,231 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,233 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,235 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,237 copying lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,239 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,241 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,243 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,246 copying lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:15:43,248 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,250 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,252 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,254 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,256 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,259 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,261 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,263 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,265 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,267 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,269 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,271 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,273 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,275 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,277 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,279 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,281 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,284 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,286 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,288 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,290 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,292 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,294 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,296 copying lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,298 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,300 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,303 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,305 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,307 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,309 copying lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:15:43,311 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,313 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,315 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,317 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,320 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,321 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,323 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,325 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,327 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,330 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,332 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,334 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,336 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,338 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,340 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,342 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,345 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,347 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,349 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,351 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,353 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,355 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,357 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,359 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,361 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,363 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,365 copying lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,368 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,370 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,372 copying lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:15:43,374 creating build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,375 copying lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,377 copying lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,379 copying lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,381 copying lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,383 copying lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,386 copying lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,388 copying lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,389 copying lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,391 copying lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,394 copying lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,396 copying lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:15:43,398 copying lm_eval/tasks/xnli/xnli_vi.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,400 copying lm_eval/tasks/xnli/xnli_tr.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,402 copying lm_eval/tasks/xnli/xnli_hi.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,404 copying lm_eval/tasks/xnli/xnli_es.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,406 copying lm_eval/tasks/xnli/xnli_th.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,408 copying lm_eval/tasks/xnli/xnli_en.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,410 copying lm_eval/tasks/xnli/xnli_de.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,412 copying lm_eval/tasks/xnli/xnli_zh.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,414 copying lm_eval/tasks/xnli/xnli_ar.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,417 copying lm_eval/tasks/xnli/xnli_el.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,419 copying lm_eval/tasks/xnli/xnli_fr.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,421 copying lm_eval/tasks/xnli/xnli_ur.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,423 copying lm_eval/tasks/xnli/xnli_ru.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,425 copying lm_eval/tasks/xnli/_xnli.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,427 copying lm_eval/tasks/xnli/xnli_sw.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,430 copying lm_eval/tasks/xnli/xnli_bg.yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:15:43,432 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,434 copying lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,436 copying lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,438 copying lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,440 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,443 copying lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,445 copying lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,447 copying lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:15:43,449 creating build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,451 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,453 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,455 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,457 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,459 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,461 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,463 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,465 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,467 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,469 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,471 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,473 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,475 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,477 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,479 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,481 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,483 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,486 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,488 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,490 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,492 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,494 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,496 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,498 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,500 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,502 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,505 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,507 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,509 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,511 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,515 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,518 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,520 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,522 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,524 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,527 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,529 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,531 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,533 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,535 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,537 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,539 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,541 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,543 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,545 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,547 copying lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,549 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,551 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,553 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,555 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:15:43,557 creating build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,558 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,561 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,564 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,566 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,569 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,572 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,574 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,577 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,579 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,583 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,586 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,588 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,590 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,593 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,595 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,598 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,601 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,603 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,606 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,609 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,611 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,614 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,617 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,620 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,622 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,625 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,628 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,630 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,633 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,636 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,638 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,641 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,643 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,646 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,649 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,652 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,654 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,658 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,661 copying lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,663 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,666 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,668 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,671 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,674 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,677 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,680 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,683 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,686 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,689 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,692 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:15:43,695 creating build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,696 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,699 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,702 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,704 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,707 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,709 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,712 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,714 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,717 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,719 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,722 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,724 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,727 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,729 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,732 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,734 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,736 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,739 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,741 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,744 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,746 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,749 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,751 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,754 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,756 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,759 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,761 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,764 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,766 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,769 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,771 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,774 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,776 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,779 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,781 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,784 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,786 copying lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,789 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,791 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,794 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,796 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,799 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,801 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,803 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,806 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,809 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,811 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,814 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,816 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,819 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:15:43,821 creating build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,823 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,826 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,828 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,831 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,833 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,836 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,838 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,840 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,843 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,846 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,848 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,851 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,853 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,856 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,858 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,861 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,864 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,866 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,869 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,871 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,874 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,876 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,879 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,881 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,884 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,886 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,889 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,892 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,894 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,897 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,899 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,902 copying lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,904 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,907 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,909 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,911 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,913 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,915 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,917 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,920 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,922 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,924 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,926 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,928 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,930 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,932 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,934 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,937 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,939 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,941 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:15:43,943 creating build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,944 copying lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,946 copying lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,948 copying lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,951 copying lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,953 copying lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,955 copying lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,957 copying lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,960 copying lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,962 copying lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,964 copying lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,966 copying lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,968 copying lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,970 copying lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,973 copying lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,975 copying lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,977 copying lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,979 copying lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,981 copying lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,983 copying lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,986 copying lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,988 copying lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,990 copying lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,992 copying lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,994 copying lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,997 copying lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:43,999 copying lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,001 copying lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,004 copying lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,006 copying lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,008 copying lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,010 copying lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,012 copying lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,015 copying lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,017 copying lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,019 copying lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,021 copying lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,024 copying lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,026 copying lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,028 copying lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,031 copying lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,033 copying lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,035 copying lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,037 copying lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,039 copying lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,041 copying lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,043 copying lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,045 copying lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,047 copying lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,049 copying lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,051 copying lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:15:44,053 copying lm_eval/tasks/meqsum/meqsum.yaml -> build/lib/lm_eval/tasks/meqsum 2026-09-01T00:15:44,056 copying lm_eval/tasks/glianorex/glianorex_en.yaml -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:15:44,058 copying lm_eval/tasks/glianorex/glianorex.yaml -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:15:44,060 copying lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:15:44,062 copying lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:15:44,064 copying lm_eval/tasks/swde/swde.yaml -> build/lib/lm_eval/tasks/swde 2026-09-01T00:15:44,066 copying lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:15:44,069 copying lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,071 copying lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,073 copying lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,076 copying lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,078 copying lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,080 copying lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,082 copying lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,084 copying lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,087 copying lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,089 copying lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,091 copying lm_eval/tasks/aclue/_aclue.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,093 copying lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,096 copying lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,098 copying lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,100 copying lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,103 copying lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:15:44,105 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:15:44,108 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,110 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,112 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,114 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,116 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,118 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,120 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,123 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,125 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,127 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,130 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,132 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,134 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,137 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,139 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,141 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,143 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,146 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,148 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,150 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,152 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,155 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,157 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,159 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,162 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,164 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,166 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,168 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,170 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,173 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,175 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,177 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,179 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,182 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,184 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,186 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,188 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,190 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,193 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,195 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,197 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,200 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,203 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,206 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,209 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,212 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,215 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,218 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,221 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,224 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,227 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,230 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,233 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,235 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,238 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,241 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,244 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,247 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:15:44,250 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:15:44,253 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:15:44,256 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,259 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,262 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,265 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,268 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,271 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,274 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,277 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,279 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,283 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:15:44,286 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,289 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,292 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,295 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,298 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,300 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,302 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,305 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,307 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,309 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,312 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,314 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,316 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,318 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,320 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,323 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,325 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,327 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,329 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,332 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,334 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,336 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,338 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,341 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,343 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,345 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,347 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,350 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,352 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,354 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,356 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,358 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,360 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,362 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,365 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,367 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,369 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,371 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,373 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,376 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,378 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,380 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,383 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,385 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,387 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,390 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,392 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,394 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,396 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,398 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,401 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,403 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,406 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,408 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,410 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,412 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,415 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,417 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,419 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:15:44,421 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:15:44,424 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:15:44,426 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:15:44,428 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:15:44,431 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:15:44,433 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:15:44,435 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:15:44,437 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:15:44,440 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:15:44,442 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:15:44,444 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:15:44,446 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:15:44,448 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:15:44,451 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:15:44,453 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:15:44,455 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:15:44,458 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:15:44,460 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:15:44,462 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:15:44,465 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:15:44,467 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:15:44,469 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:15:44,472 creating build/lib/lm_eval/tasks/lambada 2026-09-01T00:15:44,473 copying lm_eval/tasks/lambada/lambada_openai.yaml -> build/lib/lm_eval/tasks/lambada 2026-09-01T00:15:44,475 copying lm_eval/tasks/lambada/lambada_standard.yaml -> build/lib/lm_eval/tasks/lambada 2026-09-01T00:15:44,477 copying lm_eval/tasks/chartqa/chartqa.yaml -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:15:44,479 copying lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:15:44,481 copying lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:15:44,484 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:15:44,486 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:15:44,489 copying lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:15:44,491 copying lm_eval/tasks/physics_gre/physics_gre_additional.yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:15:44,493 copying lm_eval/tasks/physics_gre/physics_gre_all.yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:15:44,495 copying lm_eval/tasks/physics_gre/physics_gre.yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:15:44,497 creating build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,498 copying lm_eval/tasks/legalbench/corporate_lobbying.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,501 copying lm_eval/tasks/legalbench/contract_nli_notice_on_compelled_disclosure.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,503 copying lm_eval/tasks/legalbench/contract_nli_sharing_with_employees.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,505 copying lm_eval/tasks/legalbench/_contract_nli.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,507 copying lm_eval/tasks/legalbench/contract_nli_explicit_identification.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,509 copying lm_eval/tasks/legalbench/contract_nli_limited_use.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,512 copying lm_eval/tasks/legalbench/contract_nli_return_of_confidential_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,514 copying lm_eval/tasks/legalbench/_legalbench.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,516 copying lm_eval/tasks/legalbench/contract_nli_survival_of_obligations.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,518 copying lm_eval/tasks/legalbench/contract_nli_permissible_development_of_similar_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,520 copying lm_eval/tasks/legalbench/contract_nli_no_licensing.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,522 copying lm_eval/tasks/legalbench/international_citizenship_questions.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,525 copying lm_eval/tasks/legalbench/contract_nli_sharing_with_third-parties.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,527 copying lm_eval/tasks/legalbench/contract_nli_permissible_copy.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,529 copying lm_eval/tasks/legalbench/contract_nli_inclusion_of_verbally_conveyed_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,531 copying lm_eval/tasks/legalbench/contract_nli_confidentiality_of_agreement.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,533 copying lm_eval/tasks/legalbench/contract_nli_permissible_acquirement_of_similar_information.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,535 copying lm_eval/tasks/legalbench/contract_nli_permissible_post-agreement_possession.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,537 copying lm_eval/tasks/legalbench/abercrombie.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,539 copying lm_eval/tasks/legalbench/function_of_decision_section.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,541 copying lm_eval/tasks/legalbench/proa.yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:15:44,543 copying lm_eval/tasks/slr_bench/slr_bench_all.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:44,546 copying lm_eval/tasks/slr_bench/slr_bench_easy.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:44,548 copying lm_eval/tasks/slr_bench/slr_bench_group.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:44,550 copying lm_eval/tasks/slr_bench/slr_bench_medium.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:44,552 copying lm_eval/tasks/slr_bench/slr_bench_hard.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:44,554 copying lm_eval/tasks/slr_bench/slr_bench_basic.yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:15:44,556 creating build/lib/lm_eval/tasks/fld 2026-09-01T00:15:44,557 copying lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:15:44,559 copying lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:15:44,562 copying lm_eval/tasks/fld/fld_default.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:15:44,564 copying lm_eval/tasks/fld/fld_star.yaml -> build/lib/lm_eval/tasks/fld 2026-09-01T00:15:44,566 copying lm_eval/tasks/squad_completion/squad_completion.yaml -> build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:15:44,568 creating build/lib/lm_eval/tasks/asdiv 2026-09-01T00:15:44,569 copying lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/lib/lm_eval/tasks/asdiv 2026-09-01T00:15:44,571 copying lm_eval/tasks/asdiv/default.yaml -> build/lib/lm_eval/tasks/asdiv 2026-09-01T00:15:44,574 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,576 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,578 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,580 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,583 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,585 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,587 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,589 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,591 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,594 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,596 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,598 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,600 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,602 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,604 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,607 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,609 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,611 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,614 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,616 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,618 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,620 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,622 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,625 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,627 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,629 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,631 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,633 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,636 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,638 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,640 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,643 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,645 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,647 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,649 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,652 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,654 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,657 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,659 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,661 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,663 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,665 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,668 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,670 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,672 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,674 copying lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,677 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,679 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,681 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,683 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,685 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,688 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,690 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,692 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,694 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,697 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,699 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,701 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,703 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,706 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,708 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,711 copying lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:15:44,713 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,715 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,717 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,719 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,722 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,724 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,726 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,728 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,730 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,732 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,735 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,737 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,739 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,741 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,744 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,746 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,748 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,751 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,753 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,755 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,757 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,760 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,762 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,764 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,767 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,769 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,771 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,774 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,776 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,778 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,780 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,783 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,785 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,787 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,789 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,792 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,794 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,796 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,798 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,800 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,802 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,805 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,807 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,809 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,811 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,814 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,816 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,818 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,821 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,823 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,826 copying lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,828 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,830 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,832 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,835 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,837 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,839 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,841 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,844 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,846 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,848 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,851 copying lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:15:44,853 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,855 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,858 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,860 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,862 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,864 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,866 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,869 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,871 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,873 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,875 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,877 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,879 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,881 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,884 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,886 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,888 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,891 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,893 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,895 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,897 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,899 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,901 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,903 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,906 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,908 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,910 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,912 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,914 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,916 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,918 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,921 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,923 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,925 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,927 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,929 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,931 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,934 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,936 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,938 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,941 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,943 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,945 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,948 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,950 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,952 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,954 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,956 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,958 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,960 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,962 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,964 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,966 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,969 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,971 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,973 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,975 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,977 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,980 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,982 copying lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,984 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,986 copying lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:15:44,988 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:44,990 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:44,993 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:44,995 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:44,997 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:44,999 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,001 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,003 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,005 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,007 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,009 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,011 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,013 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,015 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,018 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,020 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,022 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,024 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,026 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,028 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,031 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,033 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,035 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,038 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,040 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,042 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,044 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,046 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,048 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,050 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,052 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,055 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,057 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,059 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,061 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,063 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,065 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,067 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,069 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,071 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,073 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,075 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,077 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,079 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,081 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,083 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,085 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,087 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,089 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,091 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,093 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,095 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,098 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,100 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,102 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,104 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,106 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,108 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,110 copying lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,112 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,114 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,116 copying lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:15:45,118 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,120 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,122 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,124 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,127 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,128 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,130 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,132 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,134 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,136 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,138 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,140 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,142 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,144 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,147 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,149 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,151 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,153 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,155 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,157 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,159 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,161 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,163 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,165 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,167 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,169 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,171 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,173 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,175 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,177 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,179 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,181 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,184 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,186 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,188 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,190 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,192 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,194 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,196 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,198 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,200 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,202 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,204 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,206 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,208 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,210 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,212 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,214 copying lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,216 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,219 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,220 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,222 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,224 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,226 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,228 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,230 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,232 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,234 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,236 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,239 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,241 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,243 copying lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:15:45,245 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,247 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,249 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,251 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,253 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,256 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,258 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,260 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,262 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,264 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,266 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,268 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,270 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,273 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,275 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,277 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,279 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,281 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,283 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,285 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,287 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,289 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,291 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,293 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,295 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,297 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,299 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,301 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,303 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,305 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,308 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,310 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,312 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,314 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,316 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,318 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,320 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,322 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,324 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,326 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,328 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,330 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,332 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,334 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,336 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,338 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,340 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,342 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,344 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,346 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,348 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,350 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,352 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,354 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,356 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,358 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,360 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,362 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,364 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,366 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,368 copying lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,370 copying lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:15:45,373 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,375 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,377 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,379 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,381 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,383 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,385 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,387 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,388 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,390 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,392 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,394 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,396 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,398 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,400 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,403 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,405 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,407 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,409 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,411 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,413 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,415 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,417 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,419 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,421 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,423 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,426 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,428 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,430 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,432 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,434 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,436 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,438 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,440 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,442 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,444 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,446 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,448 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,450 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,452 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,454 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,456 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,458 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,460 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,462 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,464 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,466 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,468 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,470 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,472 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,474 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,476 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,479 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,481 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,483 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,485 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,487 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,489 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,491 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,493 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,495 copying lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,497 copying lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:15:45,499 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,501 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,503 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,505 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,507 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,509 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,511 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,513 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,515 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,517 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,519 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,521 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,523 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,526 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,528 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,530 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,532 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,534 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,536 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,538 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,540 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,542 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,544 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,546 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,548 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,550 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,552 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,554 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,556 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,558 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,560 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,562 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,564 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,567 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,569 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,571 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,573 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,575 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,577 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,579 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,581 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,584 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,586 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,588 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,590 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,592 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,594 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,596 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,598 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,600 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,602 copying lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,604 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,606 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,608 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,610 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,612 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,614 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,616 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,618 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,620 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,622 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,624 copying lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:15:45,626 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,628 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,631 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,633 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,635 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,637 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,639 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,641 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,643 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,646 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,648 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,650 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,652 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,653 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,655 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,657 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,659 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,661 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,663 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,666 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,668 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,670 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,672 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,674 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,676 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,678 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,680 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,682 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,684 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,686 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,688 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,690 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,692 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,694 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,696 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,698 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,701 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,703 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,705 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,707 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,709 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,711 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,713 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,715 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,717 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,719 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,721 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,723 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,725 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,727 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,730 copying lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,732 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,734 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,736 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,738 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,740 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,742 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,744 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,746 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,748 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,750 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,753 copying lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:15:45,755 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,756 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,758 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,760 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,762 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,764 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,766 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,768 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,770 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,772 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,774 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,776 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,778 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,780 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,782 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,784 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,786 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,788 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,790 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,792 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,794 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,796 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,799 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,801 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,803 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,805 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,807 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,809 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,811 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,813 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,815 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,817 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,819 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,821 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,823 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,825 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,827 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,829 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,831 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,833 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,836 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,838 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,840 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,842 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,844 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,846 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,848 copying lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,850 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,852 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,854 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,856 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,859 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,861 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,863 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,865 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,867 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,869 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,871 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,873 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,875 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,877 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,879 copying lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:15:45,881 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,883 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,885 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,887 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,889 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,892 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,894 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,896 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,898 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,899 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,902 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,903 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,906 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,908 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,910 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,912 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,914 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,916 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,918 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,920 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,922 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,924 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,926 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,928 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,930 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,932 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,934 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,936 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,938 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,940 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,942 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,944 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,946 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,949 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,951 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,953 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,955 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,957 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,959 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,961 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,964 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,966 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,968 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,970 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,972 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,974 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,976 copying lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,978 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,980 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,982 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,984 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,986 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,988 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,991 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,993 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,995 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,997 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:45,999 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:46,001 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:46,003 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:46,005 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:46,008 copying lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:15:46,010 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,012 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,014 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,017 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,019 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,021 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,023 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,025 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,027 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,030 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,031 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,033 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,036 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,038 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,040 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,042 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,044 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,046 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,049 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,051 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,053 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,055 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,058 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,060 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,062 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,064 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,066 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,068 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,070 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,072 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,075 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,077 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,079 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,081 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,083 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,085 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,087 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,090 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,092 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,094 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,096 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,099 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,101 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,103 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,106 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,108 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,110 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,112 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,114 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,116 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,118 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,120 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,122 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,124 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,126 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,128 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,131 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,133 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,135 copying lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,137 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,139 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,141 copying lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:15:46,143 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,145 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,147 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,149 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,151 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,153 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,156 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,158 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,160 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,162 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,164 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,166 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,168 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,170 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,172 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,174 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,176 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,178 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,180 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,183 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,185 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,187 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,189 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,191 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,193 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,195 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,197 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,199 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,201 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,203 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,205 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,207 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,209 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,212 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,213 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,216 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,218 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,220 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,222 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,224 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,226 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,228 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,230 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,233 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,235 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,237 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,239 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,241 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,243 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,245 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,247 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,250 copying lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,251 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,253 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,255 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,257 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,260 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,262 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,264 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,267 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,269 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,271 copying lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:15:46,273 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,275 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,277 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,279 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,281 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,283 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,285 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,287 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,290 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,292 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,294 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,296 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,298 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,300 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,302 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,304 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,306 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,308 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,310 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,312 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,314 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,316 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,318 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,320 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,322 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,324 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,326 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,328 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,331 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,333 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,335 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,337 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,340 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,342 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,344 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,346 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,348 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,350 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,352 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,354 copying lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,356 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,358 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,360 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,362 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,364 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,366 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,368 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,370 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,372 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,374 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,377 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,379 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,381 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,383 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,385 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,387 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,389 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,391 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,394 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,396 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,398 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,400 copying lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:15:46,402 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,404 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,406 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,408 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,410 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,412 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,415 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,417 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,420 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,422 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,425 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,428 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,431 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,433 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,436 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,438 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,441 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,443 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,446 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,449 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,451 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,454 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,456 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,459 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,462 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,464 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,467 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,469 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,472 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,474 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,477 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,479 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,482 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,484 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,487 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,489 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,491 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,494 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,497 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,499 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,502 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,505 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,507 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,510 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,512 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,515 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,517 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,519 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,521 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,523 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,525 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,527 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,529 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,531 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,533 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,535 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,537 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,539 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,541 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,543 copying lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,545 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,547 copying lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:15:46,549 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,551 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,553 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,555 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,557 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,559 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,561 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,563 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,566 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,568 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,570 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,572 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,574 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,576 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,578 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,580 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,582 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,584 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,586 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,589 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,591 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,593 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,595 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,597 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,599 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,601 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,603 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,605 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,607 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,609 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,611 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,613 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,615 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,617 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,619 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,621 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,623 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,625 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,628 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,631 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,633 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,636 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,638 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,640 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,642 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,643 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,645 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,647 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,649 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,651 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,653 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,655 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,657 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,660 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,662 copying lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,664 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,666 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,668 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,670 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,672 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,674 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,676 copying lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:15:46,678 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,680 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,682 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,684 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,686 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,688 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,691 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,693 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,695 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,697 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,699 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,701 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,703 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,706 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,708 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,710 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,712 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,714 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,716 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,718 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,720 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,722 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,724 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,726 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,728 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,730 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,732 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,734 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,736 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,739 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,741 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,743 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,745 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,747 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,749 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,751 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,753 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,754 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,757 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,758 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,760 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,762 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,764 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,766 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,768 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,771 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,773 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,775 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,777 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,779 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,781 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,783 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,785 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,787 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,789 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,791 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,793 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,796 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,798 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,801 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,803 copying lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,805 copying lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:15:46,807 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,809 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,811 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,813 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,815 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,817 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,819 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,821 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,823 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,826 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,828 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,830 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,832 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,834 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,836 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,839 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,841 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,843 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,845 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,847 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,849 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,851 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,853 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,856 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,858 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,860 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,862 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,864 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,866 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,868 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,870 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,872 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,874 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,876 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,878 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,880 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,882 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,884 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,886 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,889 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,891 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,893 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,895 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,897 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,899 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,901 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,903 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,905 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,907 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,909 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,911 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,913 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,916 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,918 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,920 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,922 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,924 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,927 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,929 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,931 copying lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,933 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,935 copying lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:15:46,937 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,939 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,942 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,944 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,946 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,948 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,950 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,952 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,954 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,956 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,958 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,961 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,962 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,964 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,966 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,968 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,970 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,972 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,974 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,976 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,979 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,981 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,983 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,985 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,987 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,989 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,991 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,993 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,996 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:46,998 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,000 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,002 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,004 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,006 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,009 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,011 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,013 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,015 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,018 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,020 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,022 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,024 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,026 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,028 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,030 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,032 copying lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,034 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,036 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,038 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,040 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,043 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,045 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,047 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,049 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,051 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,053 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,055 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,057 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,059 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,061 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,064 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,066 copying lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:15:47,068 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,070 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,072 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,074 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,076 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,079 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,081 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,083 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,085 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,087 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,089 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,091 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,093 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,095 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,097 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,099 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,101 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,104 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,106 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,108 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,110 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,112 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,114 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,116 copying lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,118 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,120 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,122 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,124 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,127 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,129 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,131 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,133 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,135 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,137 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,139 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,141 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,143 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,145 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,147 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,149 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,151 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,154 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,156 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,158 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,160 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,162 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,164 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,167 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,169 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,171 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,173 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,176 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,178 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,180 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,182 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,184 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,186 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,188 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,190 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,192 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,194 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,196 copying lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:15:47,198 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,200 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,202 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,204 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,206 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,209 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,211 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,213 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,216 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,218 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,222 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,225 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,227 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,229 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,232 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,234 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,236 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,238 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,240 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,242 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,245 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,249 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,254 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,259 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,262 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,264 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,267 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,269 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,271 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,274 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,277 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,280 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,283 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,290 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,299 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,308 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,318 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,327 copying lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,337 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,348 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,360 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,375 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,391 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,407 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,422 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,438 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,454 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,470 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,486 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,500 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,502 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,504 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,506 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,508 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,510 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,512 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,514 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,517 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,737 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,739 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,741 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,743 copying lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:15:47,745 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,748 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,750 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,752 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,754 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,756 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,758 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,761 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,763 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,765 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,767 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,769 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,771 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,773 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,775 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,777 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,780 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,782 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,783 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,786 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,788 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,790 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,792 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,794 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,796 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,799 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,801 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,804 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,806 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,808 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,810 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,812 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,814 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,816 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,818 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,820 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,822 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,825 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,827 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,829 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,831 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,833 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,835 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,837 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,839 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,841 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,844 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,846 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,848 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,850 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,852 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,854 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,857 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,859 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,861 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,863 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,866 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,868 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,870 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,872 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,874 copying lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,876 copying lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:15:47,879 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,881 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,883 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,885 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,887 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,889 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,891 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,893 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,896 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,898 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,900 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,902 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,904 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,906 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,909 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,911 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,913 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,915 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,917 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,919 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,921 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,924 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,927 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,930 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,933 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,936 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,939 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,942 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,945 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,948 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,951 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,954 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,957 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,960 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,963 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,966 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,969 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,972 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,975 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,978 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,981 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,984 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,988 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,991 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,994 copying lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:47,997 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,000 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,003 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,006 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,009 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,012 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,015 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,018 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,020 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,023 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,026 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,028 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,030 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,033 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,035 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,037 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,039 copying lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:15:48,041 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,043 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,046 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,048 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,050 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,052 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,054 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,056 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,059 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,061 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,063 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,065 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,067 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,069 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,071 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,073 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,075 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,077 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,080 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,082 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,084 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,086 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,088 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,090 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,092 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,094 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,096 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,098 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,100 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,102 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,104 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,107 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,109 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,111 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,113 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,115 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,117 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,119 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,121 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,123 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,126 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,128 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,130 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,132 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,134 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,136 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,138 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,141 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,143 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,145 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,147 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,149 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,151 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,153 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,156 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,158 copying lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,160 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,162 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,164 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,166 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,169 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,171 copying lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:15:48,173 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,175 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,177 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,179 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,181 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,184 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,186 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,188 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,190 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,192 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,194 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,196 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,198 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,201 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,203 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,205 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,207 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,209 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,211 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,213 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,215 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,218 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,220 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,222 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,224 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,226 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,229 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,231 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,233 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,235 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,237 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,239 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,241 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,243 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,246 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,248 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,250 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,252 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,254 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,256 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,258 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,260 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,263 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,265 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,267 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,269 copying lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,271 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,273 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,276 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,278 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,280 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,282 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,284 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,287 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,289 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,291 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,293 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,295 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,297 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,299 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,301 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,303 copying lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:15:48,305 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,308 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,310 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,312 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,315 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,320 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,327 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,330 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,332 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,334 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,338 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,348 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,359 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,373 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,386 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,400 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,414 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,428 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,442 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,456 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,469 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,483 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,497 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,509 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,516 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,521 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,529 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,536 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,544 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,550 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,558 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,570 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,578 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,583 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,588 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,594 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,600 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,607 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,614 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,620 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,627 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,634 copying lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,637 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,639 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,641 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,643 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,645 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,647 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,649 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,651 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,653 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,655 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,657 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,659 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,661 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,663 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,665 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,667 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,669 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,672 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,674 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,676 copying lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:15:48,678 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,680 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,682 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,684 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,686 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,688 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,690 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,692 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,694 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,696 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,699 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,701 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,703 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,705 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,707 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,709 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,710 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,713 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,715 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,717 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,719 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,721 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,723 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,726 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,728 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,730 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,733 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,736 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,739 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,741 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,744 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,748 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,750 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,753 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,756 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,759 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,762 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,765 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,767 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,770 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,773 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,776 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,779 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,782 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,785 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,788 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,790 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,793 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,796 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,799 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,802 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,804 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,807 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,810 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,813 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,816 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,818 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,821 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,824 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,827 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,830 copying lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,832 copying lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:15:48,835 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,837 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,839 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,841 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,844 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,846 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,848 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,851 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,853 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,855 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,857 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,859 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,861 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,863 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,866 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,868 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,870 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,872 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,875 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,877 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,879 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,882 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,884 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,886 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,888 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,891 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,893 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,896 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,898 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,900 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,902 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,904 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,906 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,909 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,911 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,913 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,915 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,917 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,920 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,922 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,924 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,926 copying lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,928 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,931 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,933 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,935 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,937 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,939 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,941 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,944 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,946 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,948 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,950 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,952 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,955 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,957 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,959 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,962 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,964 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,966 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,969 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,971 copying lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:15:48,973 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,975 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,977 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,980 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,982 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,984 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,987 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,989 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,991 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,993 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,996 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:48,998 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,000 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,002 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,005 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,007 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,010 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,012 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,014 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,016 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,018 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,020 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,022 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,025 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,027 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,029 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,031 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,033 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,035 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,037 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,039 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,041 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,044 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,046 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,048 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,050 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,052 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,055 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,057 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,059 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,061 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,063 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,066 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,068 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,070 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,072 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,074 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,077 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,079 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,082 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,084 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,087 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,090 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,092 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,094 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,097 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,099 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,101 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,104 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,106 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,108 copying lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,110 copying lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:15:49,112 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,114 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,117 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,119 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,121 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,123 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,126 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,128 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,130 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,132 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,134 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,137 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,139 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,141 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,143 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,146 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,148 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,150 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,152 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,155 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,157 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,159 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,161 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,163 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,166 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,168 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,170 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,172 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,174 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,177 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,179 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,181 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,184 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,186 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,188 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,190 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,193 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,195 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,197 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,199 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,201 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,203 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,206 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,208 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,210 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,213 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,215 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,217 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,219 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,221 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,224 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,226 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,228 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,231 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,233 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,235 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,238 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,240 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,242 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,244 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,247 copying lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,250 copying lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:15:49,252 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,254 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,256 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,259 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,261 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,263 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,265 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,268 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,270 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,272 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,274 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,276 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,278 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,280 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,283 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,285 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,287 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,289 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,291 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,293 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,295 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,298 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,300 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,302 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,304 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,306 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,309 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,311 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,313 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,315 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,317 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,319 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,321 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,323 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,325 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,327 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,329 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,332 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,334 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,336 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,338 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,340 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,343 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,345 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,347 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,349 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,351 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,353 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,355 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,357 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,360 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,362 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,364 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,366 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,368 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,370 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,372 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,374 copying lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,376 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,378 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,380 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,383 copying lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:15:49,385 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,387 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,389 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,391 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,393 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,395 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,397 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,399 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,402 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,404 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,406 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,408 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,411 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,413 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,415 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,417 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,419 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,421 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,424 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,426 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,428 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,430 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,432 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,434 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,436 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,439 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,441 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,443 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,445 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,447 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,449 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,452 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,454 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,456 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,458 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,460 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,462 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,464 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,467 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,469 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,471 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,473 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,475 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,477 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,479 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,481 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,483 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,486 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,488 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,490 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,492 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,494 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,496 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,498 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,500 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,503 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,714 copying lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,723 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,734 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,746 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,758 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,770 copying lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:15:49,777 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,784 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,791 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,799 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,807 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,815 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,823 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,835 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,848 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,864 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,878 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,880 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,882 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,884 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,887 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,889 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,891 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,893 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,895 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,897 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,899 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,901 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,903 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,906 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,908 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,910 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,912 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,914 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,916 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,919 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,921 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,922 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,924 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,926 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,928 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,930 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,933 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,935 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,937 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,939 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,941 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,943 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,945 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,947 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,950 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,952 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,954 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,956 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,958 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,960 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,962 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,964 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,966 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,969 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,971 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,973 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,975 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,977 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,979 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,981 copying lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,983 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,985 copying lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:15:49,987 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:49,989 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:49,991 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:49,993 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:49,995 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:49,997 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,000 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,002 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,004 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,006 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,008 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,010 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,012 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,015 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,017 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,019 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,021 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,023 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,025 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,028 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,030 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,032 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,034 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,036 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,038 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,040 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,042 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,044 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,046 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,048 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,050 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,052 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,054 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,056 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,058 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,060 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,062 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,064 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,067 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,069 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,071 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,073 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,075 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,077 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,079 copying lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,081 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,083 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,085 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,087 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,089 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,091 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,093 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,095 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,097 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,099 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,101 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,103 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,105 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,107 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,109 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,111 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,113 copying lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:15:50,115 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,117 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,119 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,121 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,123 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,125 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,127 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,129 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,132 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,134 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,136 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,138 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,141 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,143 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,145 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,147 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,149 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,151 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,153 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,155 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,157 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,159 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,161 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,163 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,166 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,168 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,170 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,172 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,174 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,176 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,178 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,180 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,182 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,184 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,187 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,189 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,191 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,193 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,195 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,196 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,198 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,200 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,202 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,204 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,206 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,208 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,211 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,213 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,215 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,217 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,219 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,221 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,223 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,225 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,227 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,229 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,231 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,234 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,236 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,238 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,240 copying lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,242 copying lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:15:50,245 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,248 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,250 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,253 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,256 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,259 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,261 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,264 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,267 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,269 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,272 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,275 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,278 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,280 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,283 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,286 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,289 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,292 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,295 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,297 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,300 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,303 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,305 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,308 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,311 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,314 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,316 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,319 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,322 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,324 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,327 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,329 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,332 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,334 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,338 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,340 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,343 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,345 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,347 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,349 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,351 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,353 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,354 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,356 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,359 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,361 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,363 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,365 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,367 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,369 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,371 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,373 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,375 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,377 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,379 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,381 copying lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,383 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,385 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,387 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,389 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,391 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,393 copying lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:15:50,395 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,397 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,399 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,401 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,403 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,405 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,407 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,409 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,411 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,413 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,415 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,417 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,419 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,422 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,424 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,426 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,428 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,429 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,431 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,433 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,435 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,437 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,439 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,441 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,443 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,445 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,447 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,449 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,451 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,453 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,455 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,457 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,459 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,461 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,463 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,465 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,467 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,469 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,471 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,473 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,475 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,477 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,479 copying lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,481 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,483 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,485 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,487 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,489 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,491 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,493 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,495 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,497 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,499 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,501 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,503 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,506 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,508 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,510 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,512 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,514 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,516 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,518 copying lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:15:50,520 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,522 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,524 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,526 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,528 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,531 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,533 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,535 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,537 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,539 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,541 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,542 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,544 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,546 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,548 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,550 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,552 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,554 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,556 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,558 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,561 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,563 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,565 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,567 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,569 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,571 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,573 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,576 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,578 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,580 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,582 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,584 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,586 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,588 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,590 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,592 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,594 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,596 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,599 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,601 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,603 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,605 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,607 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,609 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,611 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,613 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,615 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,618 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,620 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,622 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,624 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,626 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,629 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,631 copying lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,633 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,635 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,637 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,640 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,641 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,643 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,645 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,647 copying lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:15:50,649 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,651 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,654 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,656 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,658 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,660 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,662 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,664 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,666 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,668 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,670 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,672 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,674 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,676 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,678 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,680 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,682 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,685 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,687 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,689 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,691 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,693 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,695 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,697 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,699 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,701 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,703 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,706 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,708 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,710 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,712 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,714 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,716 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,718 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,721 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,723 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,725 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,727 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,729 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,732 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,734 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,736 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,738 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,740 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,742 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,744 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,746 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,748 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,750 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,752 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,754 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,756 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,758 copying lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,760 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,762 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,764 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,766 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,768 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,770 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,772 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,774 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,777 copying lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:15:50,779 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,781 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,783 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,785 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,787 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,789 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,791 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,793 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,795 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,797 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,799 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,801 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,803 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,806 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,807 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,809 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,811 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,813 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,815 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,817 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,819 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,821 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,823 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,825 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,827 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,830 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,831 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,833 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,836 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,838 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,840 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,842 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,844 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,846 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,848 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,851 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,853 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,855 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,857 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,859 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,861 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,863 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,865 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,867 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,869 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,871 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,873 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,875 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,878 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,880 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,882 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,884 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,886 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,888 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,890 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,892 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,894 copying lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,897 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,899 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,901 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,903 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,906 copying lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:15:50,908 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,910 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,912 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,913 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,915 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,917 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,919 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,921 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,923 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,925 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,927 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,929 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,931 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,933 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,935 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,937 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,939 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,941 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,943 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,945 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,947 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,949 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,952 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,954 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,956 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,958 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,960 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,962 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,964 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,966 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,967 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,969 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,971 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,973 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,975 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,977 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,979 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,981 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,983 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,985 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,987 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,989 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,991 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,993 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,995 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,997 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:50,999 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,001 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,003 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,006 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,008 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,010 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,012 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,014 copying lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,016 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,018 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,019 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,021 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,023 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,025 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,027 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,029 copying lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:15:51,031 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,033 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,035 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,037 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,039 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,041 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,043 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,045 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,047 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,049 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,051 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,053 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,056 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,058 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,060 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,062 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,064 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,066 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,068 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,070 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,072 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,074 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,076 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,078 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,080 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,082 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,084 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,086 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,088 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,090 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,092 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,095 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,097 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,099 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,101 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,103 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,105 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,107 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,109 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,111 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,113 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,116 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,118 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,120 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,122 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,123 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,125 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,127 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,129 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,131 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,133 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,135 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,137 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,139 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,141 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,143 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,145 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,147 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,149 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,151 copying lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,153 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,156 copying lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:15:51,158 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,160 copying lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,162 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,164 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,166 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,168 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,170 copying lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:15:51,172 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,174 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,176 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,178 copying lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,180 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,182 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,184 copying lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:15:51,186 copying lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,188 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,190 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,192 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,194 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,196 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,198 copying lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:15:51,200 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,202 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,204 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,207 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,209 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,211 copying lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,213 copying lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:15:51,215 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,217 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,219 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,221 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,223 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,225 copying lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,227 copying lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:15:51,229 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,231 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,233 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,235 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,237 copying lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,239 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,241 copying lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:15:51,243 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,245 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,247 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,249 copying lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,251 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,253 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,256 copying lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:15:51,258 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,260 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,262 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,264 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,266 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,268 copying lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,270 copying lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:15:51,272 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,274 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,276 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,278 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,280 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,282 copying lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,284 copying lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:15:51,286 copying lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,288 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,290 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,292 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,294 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,296 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,298 copying lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:15:51,300 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,302 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,304 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,306 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,308 copying lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,310 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,312 copying lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:15:51,314 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,317 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,319 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,321 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,323 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,325 copying lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,327 copying lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:15:51,329 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,331 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,333 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,335 copying lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,337 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,339 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,341 copying lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:15:51,343 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,345 copying lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,347 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,349 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,351 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,353 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,355 copying lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:15:51,357 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,359 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,361 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,363 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,365 copying lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,367 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,369 copying lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:15:51,371 creating build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,372 copying lm_eval/tasks/longbench2/news_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,374 copying lm_eval/tasks/longbench2/translate.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,376 copying lm_eval/tasks/longbench2/graph.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,378 copying lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,380 copying lm_eval/tasks/longbench2/longbench2_code.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,382 copying lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,384 copying lm_eval/tasks/longbench2/agent_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,386 copying lm_eval/tasks/longbench2/detective.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,388 copying lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,390 copying lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,392 copying lm_eval/tasks/longbench2/legal_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,394 copying lm_eval/tasks/longbench2/table.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,396 copying lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,398 copying lm_eval/tasks/longbench2/dialogue_history.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,400 copying lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,403 copying lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,404 copying lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,406 copying lm_eval/tasks/longbench2/many_shot.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,409 copying lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,411 copying lm_eval/tasks/longbench2/event_order.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,413 copying lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,415 copying lm_eval/tasks/longbench2/legal_multi.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,416 copying lm_eval/tasks/longbench2/academic_single.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,418 copying lm_eval/tasks/longbench2/user_guide.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,420 copying lm_eval/tasks/longbench2/_longbench2.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,422 copying lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:15:51,424 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,426 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,428 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,430 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,433 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,435 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,437 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,439 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,442 copying lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:15:51,444 copying lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,446 copying lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,448 copying lm_eval/tasks/basque_bench/paws_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,450 copying lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,453 copying lm_eval/tasks/basque_bench/basque_bench.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,455 copying lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,457 copying lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,459 copying lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,461 copying lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:15:51,463 copying lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,466 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,469 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,471 copying lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,474 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,476 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,478 copying lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,480 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,483 copying lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,485 copying lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,487 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,489 copying lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,491 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,493 copying lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,495 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,497 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,499 copying lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:15:51,502 copying lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,504 copying lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,506 copying lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,508 copying lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,510 copying lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,512 copying lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,515 copying lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,517 copying lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,519 copying lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,521 copying lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,523 copying lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,525 copying lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,528 copying lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,530 copying lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,532 copying lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,534 copying lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,537 copying lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,539 copying lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:15:51,542 copying lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,545 copying lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,547 copying lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,549 copying lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,551 copying lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,553 copying lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,556 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,558 copying lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,560 copying lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,562 copying lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,564 copying lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,566 copying lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,568 copying lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,570 copying lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,572 copying lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,574 copying lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,577 copying lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,579 copying lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,581 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,584 copying lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,586 copying lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,588 copying lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,590 copying lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,592 copying lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,594 copying lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,596 copying lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,598 copying lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,600 copying lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,603 copying lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,605 copying lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,607 copying lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,610 copying lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,612 copying lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,614 copying lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,616 copying lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,618 copying lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,621 copying lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,623 copying lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,625 copying lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,627 copying lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,629 copying lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,631 copying lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,633 copying lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,635 copying lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,637 copying lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,639 copying lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,641 copying lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:15:51,643 copying lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:51,646 copying lm_eval/tasks/kormedmcqa/pharm.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:51,648 copying lm_eval/tasks/kormedmcqa/doctor.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:51,650 copying lm_eval/tasks/kormedmcqa/dentist.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:51,652 copying lm_eval/tasks/kormedmcqa/nurse.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:15:51,654 copying lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,656 copying lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,658 copying lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,660 copying lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,662 copying lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,664 copying lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,667 copying lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,669 copying lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,671 copying lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,673 copying lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,676 copying lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,678 copying lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,683 copying lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,686 copying lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,688 copying lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,694 copying lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,696 copying lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,698 copying lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,701 copying lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,703 copying lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,706 copying lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,709 copying lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,711 copying lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,713 copying lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,715 copying lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,718 copying lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,720 copying lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,724 copying lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,728 copying lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,732 copying lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,734 copying lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,736 copying lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,738 copying lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,741 copying lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,743 copying lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,745 copying lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,748 copying lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,750 copying lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,752 copying lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,754 copying lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,756 copying lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,759 copying lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,761 copying lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,764 copying lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,766 copying lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,768 copying lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,770 copying lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,772 copying lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,775 copying lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,777 copying lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,779 copying lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,780 copying lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,784 copying lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,786 copying lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,789 copying lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,791 copying lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,793 copying lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,795 copying lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,797 copying lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,799 copying lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,801 copying lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,803 copying lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,806 copying lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,810 copying lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,812 copying lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,814 copying lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,816 copying lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,818 copying lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:15:51,820 copying lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,822 copying lm_eval/tasks/mmmu/_art_and_design.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,825 copying lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,828 copying lm_eval/tasks/mmmu/mmmu_music.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,833 copying lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,838 copying lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,843 copying lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,846 copying lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,849 copying lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,851 copying lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,853 copying lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,855 copying lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,857 copying lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,859 copying lm_eval/tasks/mmmu/mmmu_history.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,862 copying lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,864 copying lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,866 copying lm_eval/tasks/mmmu/_science.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,869 copying lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,872 copying lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,875 copying lm_eval/tasks/mmmu/mmmu_design.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,877 copying lm_eval/tasks/mmmu/_mmmu.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,879 copying lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,881 copying lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,883 copying lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,888 copying lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,892 copying lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,894 copying lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,898 copying lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,900 copying lm_eval/tasks/mmmu/mmmu_math.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,902 copying lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,905 copying lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,907 copying lm_eval/tasks/mmmu/mmmu_art.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,909 copying lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,911 copying lm_eval/tasks/mmmu/_business.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,915 copying lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,918 copying lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,921 copying lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:15:51,923 copying lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:15:51,925 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:15:51,928 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:15:51,930 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:15:51,934 copying lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:15:51,937 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,939 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,941 copying lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,943 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,946 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,948 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,951 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,953 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,955 copying lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:15:51,958 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,960 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,965 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,967 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,970 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,972 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,975 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:15:51,978 copying lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:15:51,981 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:15:51,983 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:15:51,987 copying lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:15:51,991 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:51,993 copying lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:51,995 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:51,998 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:52,000 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:52,003 copying lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:15:52,005 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,007 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,010 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,012 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,015 copying lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,017 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,019 copying lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:15:52,022 copying lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:52,024 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:52,026 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:52,028 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:52,030 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:52,032 copying lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:15:52,035 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:15:52,037 copying lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:15:52,039 copying lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:15:52,041 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:52,044 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:52,046 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:52,048 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:52,050 copying lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:52,053 copying lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:15:52,055 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,057 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,060 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,062 copying lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,064 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,066 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,069 copying lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:15:52,071 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:15:52,073 copying lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:15:52,075 copying lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:15:52,077 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:52,079 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:52,081 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:52,084 copying lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:52,086 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:52,088 copying lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:15:52,090 copying lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:15:52,093 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:15:52,095 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:15:52,097 copying lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:15:52,099 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:52,102 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:52,104 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:52,106 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:52,108 copying lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:52,111 copying lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:15:52,113 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:52,115 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:52,117 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:52,119 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:52,121 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:52,124 copying lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:15:52,126 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:15:52,128 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:15:52,130 copying lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:15:52,132 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:15:52,135 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:15:52,137 copying lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:15:52,139 copying lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:15:52,141 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:15:52,144 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:15:52,146 copying lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:15:52,148 copying lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:15:52,150 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:15:52,153 copying lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:15:52,155 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:15:52,157 copying lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:15:52,160 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:52,162 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:52,164 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:52,166 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:52,169 copying lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:52,171 copying lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:15:52,173 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,175 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,178 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,180 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,182 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,184 copying lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,186 copying lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:15:52,188 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:15:52,191 copying lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:15:52,193 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:15:52,195 copying lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:15:52,198 copying lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:52,200 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:52,202 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:52,204 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:52,206 copying lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:15:52,209 copying lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:52,211 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:52,213 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:52,215 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:52,217 copying lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:15:52,220 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:52,222 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:52,224 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:52,226 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north_macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:52,228 copying lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:15:52,230 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:52,232 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:52,234 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:52,236 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:52,239 copying lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:52,241 copying lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:15:52,243 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:52,245 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:52,247 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:52,249 copying lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:52,252 copying lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:15:52,254 copying lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:15:52,256 copying lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:15:52,258 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:15:52,260 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:15:52,262 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:15:52,265 copying lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:15:52,267 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,269 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,271 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,273 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,276 copying lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,278 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,280 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,282 copying lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:15:52,284 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,286 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,289 copying lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,291 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,293 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,295 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,297 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,299 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,302 copying lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:15:52,304 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:15:52,307 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:15:52,309 copying lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:15:52,312 copying lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:15:52,314 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:15:52,316 copying lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:15:52,318 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:15:52,321 copying lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:15:52,323 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:52,325 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:52,327 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:52,329 copying lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:52,332 copying lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:15:52,334 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:15:52,336 copying lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:15:52,338 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:15:52,340 copying lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:15:52,342 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,345 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,347 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,349 copying lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,351 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,354 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,356 copying lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:15:52,358 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:15:52,360 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:15:52,362 copying lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:15:52,364 copying lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:15:52,366 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:52,368 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:52,371 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:52,373 copying lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:52,375 copying lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:15:52,377 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:15:52,380 copying lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:15:52,382 copying lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:15:52,384 copying lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:15:52,386 copying lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:15:52,388 copying lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:15:52,390 copying lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:15:52,392 copying lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:15:52,395 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:15:52,397 copying lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:15:52,399 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,401 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,403 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,406 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,408 copying lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,411 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,413 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,415 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,418 copying lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:15:52,420 copying lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:52,423 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:52,425 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:52,428 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:52,430 copying lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:15:52,433 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:15:52,436 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:15:52,438 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:15:52,440 copying lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:15:52,656 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,660 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,664 copying lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,668 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,672 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,675 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,679 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,683 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,687 copying lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:15:52,691 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,694 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,698 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,704 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,709 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,714 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,718 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:15:52,721 copying lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:15:52,725 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:15:52,728 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:15:52,732 copying lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:15:52,735 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:52,739 copying lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:52,742 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:52,746 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:52,750 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:52,754 copying lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:15:52,758 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,761 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,764 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,767 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,771 copying lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,774 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,777 copying lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:15:52,781 copying lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:52,784 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:52,786 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:52,789 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:52,791 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:52,793 copying lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:15:52,795 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:15:52,797 copying lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:15:52,799 copying lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:15:52,801 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:52,804 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:52,806 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:52,808 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:52,810 copying lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:52,812 copying lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:15:52,814 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,816 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,818 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,820 copying lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,822 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,824 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,826 copying lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:15:52,828 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:15:52,830 copying lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:15:52,833 copying lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:15:52,835 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:52,837 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:52,839 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:52,841 copying lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:52,843 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:52,846 copying lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:15:52,848 copying lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:15:52,850 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:15:52,852 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:15:52,854 copying lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:15:52,856 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:52,858 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:52,860 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:52,862 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:52,864 copying lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:52,866 copying lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:15:52,869 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:52,871 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:52,873 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:52,876 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:52,878 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:52,880 copying lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:15:52,883 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:15:52,886 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:15:52,888 copying lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:15:52,891 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:15:52,893 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:15:52,896 copying lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:15:52,898 copying lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:15:52,900 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:15:52,902 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:15:52,905 copying lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:15:52,907 copying lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:15:52,909 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:15:52,912 copying lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:15:52,914 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:15:52,916 copying lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:15:52,919 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:52,921 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:52,923 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:52,925 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:52,927 copying lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:52,930 copying lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:15:52,933 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,935 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,938 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,941 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,944 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,947 copying lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,949 copying lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:15:52,952 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:15:52,955 copying lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:15:52,957 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:15:52,959 copying lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:15:52,962 copying lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:52,965 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:52,968 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:52,970 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:52,973 copying lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:15:52,976 copying lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:52,979 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:52,981 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:52,984 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:52,987 copying lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:15:52,990 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:52,992 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:52,995 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:52,998 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north_macedonian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:53,000 copying lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:15:53,003 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:53,005 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:53,008 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:53,010 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:53,013 copying lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:53,015 copying lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:15:53,018 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:53,021 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:53,023 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:53,025 copying lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:53,030 copying lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:15:53,032 copying lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:15:53,035 copying lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:15:53,037 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:15:53,040 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:15:53,042 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:15:53,045 copying lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:15:53,047 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,050 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,053 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,056 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,058 copying lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,061 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,063 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,066 copying lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:15:53,069 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,071 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,073 copying lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,076 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,078 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,081 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,083 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,085 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,089 copying lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:15:53,091 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:15:53,094 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:15:53,096 copying lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:15:53,099 copying lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:15:53,102 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:15:53,105 copying lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:15:53,108 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:15:53,111 copying lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:15:53,113 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:53,116 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:53,118 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:53,120 copying lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:53,123 copying lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:15:53,126 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:15:53,129 copying lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:15:53,131 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:15:53,134 copying lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:15:53,137 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,141 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,143 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,146 copying lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,149 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,152 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,155 copying lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:15:53,159 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:15:53,162 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:15:53,164 copying lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:15:53,167 copying lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:15:53,171 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:53,173 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:53,176 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:53,179 copying lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:53,181 copying lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:15:53,184 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:15:53,187 copying lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:15:53,189 copying lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:15:53,191 copying lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:15:53,194 copying lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:15:53,197 copying lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:15:53,199 copying lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:15:53,202 copying lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:15:53,205 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:15:53,208 copying lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:15:53,211 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,214 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,217 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,220 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,223 copying lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,225 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,228 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,231 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,234 copying lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:15:53,237 copying lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:53,241 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:53,243 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:53,245 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:53,248 copying lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:15:53,250 copying lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:15:53,252 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:15:53,254 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:15:53,257 copying lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:15:53,259 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,261 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,263 copying lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,266 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,268 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,270 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,272 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,275 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,277 copying lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:15:53,279 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,282 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,284 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,286 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,289 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,291 copying lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,293 copying lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:15:53,295 copying lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:15:53,298 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:15:53,300 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:15:53,302 copying lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:15:53,305 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:53,307 copying lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:53,309 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:53,312 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:53,314 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:53,316 copying lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:15:53,318 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,321 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,323 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,325 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,328 copying lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,330 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,332 copying lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:15:53,335 copying lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:53,337 copying lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:53,339 copying lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:53,342 copying lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:53,344 copying lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:53,346 copying lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:15:53,349 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:15:53,351 copying lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:15:53,353 copying lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:15:53,355 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:53,358 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:53,360 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:53,362 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:53,364 copying lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:53,367 copying lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:15:53,369 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,371 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,374 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,376 copying lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,378 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,381 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,383 copying lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:15:53,385 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:15:53,387 copying lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:15:53,390 copying lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:15:53,392 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:53,395 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:53,397 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:53,399 copying lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:53,401 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:53,403 copying lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:15:53,405 copying lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:15:53,408 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:15:53,410 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:15:53,412 copying lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:15:53,414 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:53,417 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:53,419 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:53,421 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:53,423 copying lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:53,426 copying lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:15:53,428 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:53,430 copying lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:53,433 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:53,435 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:53,437 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:53,440 copying lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:15:53,442 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:15:53,445 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:15:53,448 copying lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:15:53,451 copying lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:15:53,454 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:15:53,456 copying lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:15:53,458 copying lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:15:53,461 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:15:53,463 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:15:53,465 copying lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:15:53,467 copying lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:15:53,470 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:15:53,472 copying lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:15:53,474 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:15:53,476 copying lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:15:53,479 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:53,481 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:53,483 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:53,485 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:53,487 copying lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:53,490 copying lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:15:53,493 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,495 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,499 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,502 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,504 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,507 copying lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,510 copying lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:15:53,513 copying lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:15:53,516 copying lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:15:53,519 copying lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:15:53,521 copying lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:15:53,524 copying lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:53,528 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:53,530 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:53,533 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:53,536 copying lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:15:53,543 copying lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:53,547 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:53,551 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:53,554 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:53,557 copying lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:15:53,559 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:53,562 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:53,566 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:53,569 copying lm_eval/tasks/include/default/North Macedonian/_include_base_44_north_macedonian.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:53,572 copying lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:15:53,575 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:53,578 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:53,581 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:53,584 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:53,587 copying lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:53,590 copying lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:15:53,594 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:53,596 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:53,599 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:53,601 copying lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:53,603 copying lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:15:53,605 copying lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:15:53,607 copying lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:15:53,610 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:15:53,612 copying lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:15:53,614 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:15:53,616 copying lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:15:53,618 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,620 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,622 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,625 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,627 copying lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,629 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,631 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,633 copying lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:15:53,636 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,638 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,640 copying lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,642 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,644 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,646 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,649 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,651 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,653 copying lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:15:53,655 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:15:53,657 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:15:53,659 copying lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:15:53,661 copying lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:15:53,663 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:15:53,666 copying lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:15:53,668 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:15:53,670 copying lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:15:53,672 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:53,675 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:53,677 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:53,679 copying lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:53,681 copying lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:15:53,683 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:15:53,686 copying lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:15:53,688 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:15:53,690 copying lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:15:53,692 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,694 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,696 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,699 copying lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,701 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,703 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,705 copying lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:15:53,707 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:15:53,709 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:15:53,711 copying lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:15:53,713 copying lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:15:53,716 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:53,718 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:53,720 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:53,722 copying lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:53,724 copying lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:15:53,726 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:15:53,728 copying lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:15:53,731 copying lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:15:53,733 copying lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:15:53,735 copying lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:15:53,737 copying lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:15:53,739 copying lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:15:53,741 copying lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:15:53,743 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:15:53,746 copying lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:15:53,748 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,750 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,753 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,755 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,757 copying lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,759 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,761 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,763 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,765 copying lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:15:53,768 copying lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:53,770 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:53,772 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:53,774 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:53,776 copying lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:15:53,778 copying lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,780 copying lm_eval/tasks/longbench/musique.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,782 copying lm_eval/tasks/longbench/_longbench_multi.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,784 copying lm_eval/tasks/longbench/repobench-p.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,787 copying lm_eval/tasks/longbench/multi_news_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,789 copying lm_eval/tasks/longbench/_longbench_code.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,791 copying lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,793 copying lm_eval/tasks/longbench/passage_count_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,796 copying lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,798 copying lm_eval/tasks/longbench/multi_news.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,800 copying lm_eval/tasks/longbench/gov_report.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,802 copying lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,805 copying lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,807 copying lm_eval/tasks/longbench/_longbench.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,809 copying lm_eval/tasks/longbench/qasper_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,811 copying lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,813 copying lm_eval/tasks/longbench/repobench-p_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,816 copying lm_eval/tasks/longbench/lsht.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,818 copying lm_eval/tasks/longbench/qmsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,820 copying lm_eval/tasks/longbench/qasper.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,822 copying lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,824 copying lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,826 copying lm_eval/tasks/longbench/hotpotqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,828 copying lm_eval/tasks/longbench/triviaqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,831 copying lm_eval/tasks/longbench/vcsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,833 copying lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,835 copying lm_eval/tasks/longbench/trec.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,837 copying lm_eval/tasks/longbench/lcc_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,839 copying lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,841 copying lm_eval/tasks/longbench/gov_report_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,843 copying lm_eval/tasks/longbench/_longbench_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,845 copying lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,847 copying lm_eval/tasks/longbench/triviaqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,849 copying lm_eval/tasks/longbench/lcc.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,851 copying lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,854 copying lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,856 copying lm_eval/tasks/longbench/samsum_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,858 copying lm_eval/tasks/longbench/2wikimqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,860 copying lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,863 copying lm_eval/tasks/longbench/_longbench_single.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,865 copying lm_eval/tasks/longbench/narrativeqa.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,867 copying lm_eval/tasks/longbench/samsum.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,870 copying lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,872 copying lm_eval/tasks/longbench/dureader.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,874 copying lm_eval/tasks/longbench/trec_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,877 copying lm_eval/tasks/longbench/passage_count.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,879 copying lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,881 copying lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:15:53,884 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,886 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,888 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,891 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,893 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,895 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,897 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,900 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,902 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,904 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,906 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,908 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,910 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,912 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,914 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,916 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,919 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,921 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,923 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,925 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,927 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,929 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,931 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,934 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,936 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,938 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,941 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,943 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,945 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,948 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:15:53,950 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,952 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,955 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,958 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,960 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,962 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,964 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,967 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,969 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,971 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,973 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,975 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,977 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,979 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,981 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,984 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,986 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,988 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,990 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,992 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,995 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,997 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:53,999 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,001 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,004 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,006 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,008 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,010 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,012 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,015 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,017 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,019 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,022 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,024 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:15:54,026 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,028 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,030 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,033 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,035 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,037 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,039 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,041 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,043 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,045 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,047 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,049 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,052 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,054 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,056 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,058 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,060 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,063 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,065 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,067 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,069 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,072 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,074 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,076 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,078 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,081 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,083 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,085 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,087 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,089 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,091 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,093 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,096 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,098 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,100 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,102 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,104 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,106 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,108 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,111 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,113 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,115 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,117 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,120 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,122 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,124 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,127 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,129 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,131 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,133 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,136 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,138 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,140 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,143 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,145 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,147 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,149 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,151 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,153 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,155 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,158 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,160 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:15:54,162 copying lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,164 copying lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,166 copying lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,168 copying lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,170 copying lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,172 copying lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,175 copying lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,177 copying lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,179 copying lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,181 copying lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,184 copying lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,186 copying lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,188 copying lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,190 copying lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,193 copying lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,195 copying lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,197 copying lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,200 copying lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,202 copying lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,204 copying lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,206 copying lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,208 copying lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,210 copying lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,213 copying lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,215 copying lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,217 copying lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,219 copying lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,221 copying lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,223 copying lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,226 copying lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,228 copying lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:15:54,230 copying lm_eval/tasks/kobest/kobest_boolq.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:54,233 copying lm_eval/tasks/kobest/kobest_wic.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:54,235 copying lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:54,237 copying lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:54,240 copying lm_eval/tasks/kobest/kobest_copa.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:54,242 copying lm_eval/tasks/kobest/_kobest.yaml -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:15:54,245 copying lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/lib/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:15:54,247 copying lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:54,250 copying lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:54,252 copying lm_eval/tasks/portuguese_bench/assin2_sts.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:54,254 copying lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:54,256 copying lm_eval/tasks/portuguese_bench/assin2_rte.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:15:54,259 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,261 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,263 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,266 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,268 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,270 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,272 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,274 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,277 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,279 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,281 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,283 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,286 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,288 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,290 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,292 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,295 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:15:54,297 creating build/lib/lm_eval/tasks/wmdp 2026-09-01T00:15:54,298 copying lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:15:54,300 copying lm_eval/tasks/wmdp/_wmdp.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:15:54,302 copying lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:15:54,305 copying lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:15:54,307 copying lm_eval/tasks/longproc/travel_planning_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,309 copying lm_eval/tasks/longproc/html_to_tsv_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,311 copying lm_eval/tasks/longproc/tom_tracking_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,314 copying lm_eval/tasks/longproc/pseudo_to_code_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,316 copying lm_eval/tasks/longproc/tom_tracking_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,318 copying lm_eval/tasks/longproc/path_traversal_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,321 copying lm_eval/tasks/longproc/_longproc_countdown.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,323 copying lm_eval/tasks/longproc/_longproc_tom_tracking.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,325 copying lm_eval/tasks/longproc/countdown_0.5k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,327 copying lm_eval/tasks/longproc/tom_tracking_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,330 copying lm_eval/tasks/longproc/path_traversal_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,332 copying lm_eval/tasks/longproc/countdown_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,334 copying lm_eval/tasks/longproc/_longproc.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,337 copying lm_eval/tasks/longproc/_longproc_pseudo_to_code.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,339 copying lm_eval/tasks/longproc/_longproc_html_to_tsv.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,342 copying lm_eval/tasks/longproc/_longproc_path_traversal.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,344 copying lm_eval/tasks/longproc/countdown_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,346 copying lm_eval/tasks/longproc/html_to_tsv_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,349 copying lm_eval/tasks/longproc/travel_planning_8k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,351 copying lm_eval/tasks/longproc/html_to_tsv_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,353 copying lm_eval/tasks/longproc/_longproc_travel_planning.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,355 copying lm_eval/tasks/longproc/path_traversal_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,357 copying lm_eval/tasks/longproc/pseudo_to_code_2k.yaml -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:15:54,359 creating build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,360 copying lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,363 copying lm_eval/tasks/pile/pile_github.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,365 copying lm_eval/tasks/pile/pile_enron.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,367 copying lm_eval/tasks/pile/pile_uspto.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,370 copying lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,372 copying lm_eval/tasks/pile/pile_books3.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,374 copying lm_eval/tasks/pile/pile_pile-cc.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,376 copying lm_eval/tasks/pile/pile_hackernews.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,378 copying lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,380 copying lm_eval/tasks/pile/pile_europarl.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,383 copying lm_eval/tasks/pile/pile_arxiv.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,385 copying lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,387 copying lm_eval/tasks/pile/pile_philpapers.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,389 copying lm_eval/tasks/pile/pile_gutenberg.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,391 copying lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,394 copying lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,396 copying lm_eval/tasks/pile/pile_stackexchange.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,398 copying lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,400 copying lm_eval/tasks/pile/pile_freelaw.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,403 copying lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,405 copying lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,407 copying lm_eval/tasks/pile/pile_wikipedia.yaml -> build/lib/lm_eval/tasks/pile 2026-09-01T00:15:54,410 creating build/lib/lm_eval/tasks/commonsense_qa 2026-09-01T00:15:54,411 copying lm_eval/tasks/commonsense_qa/default.yaml -> build/lib/lm_eval/tasks/commonsense_qa 2026-09-01T00:15:54,413 copying lm_eval/tasks/mathqa/mathqa.yaml -> build/lib/lm_eval/tasks/mathqa 2026-09-01T00:15:54,416 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,418 copying lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,421 copying lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,423 copying lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,426 copying lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,428 copying lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,430 copying lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,433 copying lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,435 copying lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,437 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,439 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,441 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,444 copying lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,446 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,448 copying lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,451 copying lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,453 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,455 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,458 copying lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,460 copying lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,463 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,465 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,468 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,470 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,473 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,476 copying lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,478 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,481 copying lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,484 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,486 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,489 copying lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,492 copying lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,494 copying lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,497 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,499 copying lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,502 copying lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,505 copying lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,507 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,510 copying lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,512 copying lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,515 copying lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,517 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,520 copying lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,522 copying lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,525 copying lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,527 copying lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,530 copying lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,532 copying lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,535 copying lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,537 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,540 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,542 copying lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,545 copying lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,547 copying lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,550 copying lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,552 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,555 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,558 copying lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,560 copying lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,562 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,565 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,567 copying lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,570 copying lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,572 copying lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,574 copying lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,577 copying lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,579 copying lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,581 copying lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,583 copying lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,586 copying lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,588 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,590 copying lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:15:54,592 creating build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:15:54,593 copying lm_eval/tasks/benchmarks/pythia.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:15:54,596 copying lm_eval/tasks/benchmarks/minerva_math.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:15:54,598 copying lm_eval/tasks/benchmarks/t0_eval.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:15:54,601 copying lm_eval/tasks/benchmarks/openllm.yaml -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:15:54,603 creating build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:15:54,604 copying lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:15:54,607 copying lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:15:54,610 creating build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:15:54,611 copying lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:15:54,613 copying lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,616 copying lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,618 copying lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,620 copying lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,622 copying lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,625 copying lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,627 copying lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,629 copying lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,632 copying lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,634 copying lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,637 copying lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,639 copying lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,641 copying lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,644 copying lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,646 copying lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,649 copying lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,651 copying lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,653 copying lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,656 copying lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,658 copying lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,660 copying lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,662 copying lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:15:54,665 creating build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,666 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,668 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,671 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,673 copying lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,675 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,678 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,680 copying lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,682 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,685 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,687 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,690 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,692 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,694 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,697 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,699 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,701 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:15:54,704 copying lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:15:54,706 creating build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:15:54,708 copying lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:15:54,710 creating build/lib/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:15:54,712 copying lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:15:54,714 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,717 copying lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,719 copying lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,721 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,724 copying lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,726 copying lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,728 copying lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,730 copying lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,733 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,735 copying lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,737 copying lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,739 copying lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,742 copying lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,744 copying lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,746 copying lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,749 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,751 copying lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,753 copying lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,756 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,758 copying lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,761 copying lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,763 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,765 copying lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,768 copying lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,770 copying lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,773 copying lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,776 copying lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,778 copying lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:15:54,781 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,783 copying lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,785 copying lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,788 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,791 copying lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,793 copying lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,795 copying lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,798 copying lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,800 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,803 copying lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,805 copying lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,807 copying lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,810 copying lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,812 copying lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,814 copying lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,817 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,819 copying lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,822 copying lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,824 copying lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,826 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,829 copying lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,831 copying lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,834 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,836 copying lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,838 copying lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,841 copying lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,843 copying lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,846 copying lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:15:54,848 creating build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,849 copying lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,852 copying lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,855 copying lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,857 copying lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,860 copying lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,862 copying lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,865 copying lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,867 copying lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,870 copying lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,873 copying lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,875 copying lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,878 copying lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,880 copying lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,883 copying lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,885 copying lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,888 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,890 copying lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,892 copying lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,895 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,897 copying lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,900 copying lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,902 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,905 copying lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,907 copying lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,910 copying lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,912 copying lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,915 copying lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,917 copying lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:15:54,919 creating build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,921 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,923 copying lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,926 copying lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,928 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,931 copying lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,934 copying lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,937 copying lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,939 copying lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,942 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,945 copying lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,948 copying lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,950 copying lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,953 copying lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,956 copying lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,958 copying lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,961 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,963 copying lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,965 copying lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,968 copying lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,970 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,973 copying lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,975 copying lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,978 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,981 copying lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,983 copying lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,986 copying lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,988 copying lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,990 copying lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,993 copying lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:15:54,995 copying lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:15:54,998 copying lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/lib/lm_eval/tasks/med_text_classification 2026-09-01T00:15:55,001 copying lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:15:55,004 copying lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:15:55,007 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,010 copying lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,013 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,016 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,019 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,022 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,025 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,028 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,031 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,034 copying lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,037 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,040 copying lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,042 copying lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,045 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,048 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,050 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,053 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,056 copying lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,058 copying lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,061 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,064 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,067 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,070 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,072 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,075 copying lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,078 copying lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,081 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,084 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,087 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,089 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,092 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,095 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,099 copying lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,101 copying lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,103 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,105 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,108 copying lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,110 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,112 copying lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,115 copying lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,117 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,119 copying lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,122 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,124 copying lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,126 copying lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,128 copying lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:15:55,131 creating build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:15:55,132 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:15:55,134 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:15:55,136 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:15:55,138 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,141 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,143 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,145 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,148 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,150 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,152 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,154 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,156 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,159 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,161 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,164 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,166 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,168 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,171 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,173 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,176 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,178 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,180 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,182 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,185 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,187 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,189 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,191 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,194 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,196 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,198 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,201 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,203 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,206 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,208 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,210 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,213 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,215 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,218 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,220 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,223 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,225 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,227 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,229 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,232 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,234 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,236 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,239 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,241 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,243 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,245 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,247 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,250 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:15:55,252 copying lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,254 copying lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,257 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,259 copying lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,261 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,264 copying lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,266 copying lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,268 copying lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,271 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,273 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,276 copying lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,278 copying lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,280 copying lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,283 copying lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,285 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,287 copying lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,290 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,292 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,294 copying lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,296 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,299 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,301 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,303 copying lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,306 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,308 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,310 copying lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,312 copying lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,315 copying lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,317 copying lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,319 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,322 copying lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,324 copying lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,327 copying lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,329 copying lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,331 copying lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,334 copying lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,336 copying lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,338 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,340 copying lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,342 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,345 copying lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,347 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,349 copying lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,352 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,354 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,356 copying lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,359 copying lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,361 copying lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,363 copying lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,366 copying lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,368 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,371 copying lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,373 copying lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,376 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,378 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,381 copying lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,383 copying lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,386 copying lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,388 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,390 copying lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,393 copying lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,395 copying lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,398 copying lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,400 copying lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,402 copying lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,405 copying lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,407 copying lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,409 copying lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,412 copying lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,414 copying lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,416 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,419 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,421 copying lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,423 copying lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,426 copying lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,428 copying lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,430 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,433 copying lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,435 copying lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,437 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,440 copying lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,442 copying lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,444 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,447 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,449 copying lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,452 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,454 copying lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,456 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,458 copying lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,461 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,463 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,466 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,468 copying lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,471 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,473 copying lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,475 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,478 copying lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,480 copying lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,482 copying lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,485 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,487 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,490 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,492 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,494 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,497 copying lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,499 copying lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,502 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,504 copying lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,507 copying lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,509 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,512 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,514 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,516 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,519 copying lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,521 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,523 copying lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,526 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,528 copying lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,531 copying lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,533 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,535 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,538 copying lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,541 copying lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,543 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,545 copying lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,548 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,550 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,553 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,555 copying lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,557 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,560 copying lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,562 copying lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,565 copying lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,567 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,570 copying lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:15:55,572 creating build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:15:55,573 copying lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:15:55,576 copying lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:15:55,578 copying lm_eval/tasks/super_glue/boolq/default.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2026-09-01T00:15:55,580 creating build/lib/lm_eval/tasks/super_glue/rte 2026-09-01T00:15:55,582 copying lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2026-09-01T00:15:55,584 copying lm_eval/tasks/super_glue/rte/default.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2026-09-01T00:15:55,587 copying lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:15:55,589 copying lm_eval/tasks/super_glue/wsc/default.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2026-09-01T00:15:55,591 copying lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:15:55,594 copying lm_eval/tasks/super_glue/cb/default.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2026-09-01T00:15:55,596 creating build/lib/lm_eval/tasks/super_glue/wic 2026-09-01T00:15:55,597 copying lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2026-09-01T00:15:55,599 copying lm_eval/tasks/super_glue/wic/default.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2026-09-01T00:15:55,602 copying lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:15:55,604 copying lm_eval/tasks/super_glue/record/default.yaml -> build/lib/lm_eval/tasks/super_glue/record 2026-09-01T00:15:55,607 copying lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:15:55,610 copying lm_eval/tasks/super_glue/multirc/default.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2026-09-01T00:15:55,612 copying lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:15:55,615 copying lm_eval/tasks/super_glue/copa/default.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2026-09-01T00:15:55,617 copying lm_eval/tasks/toxigen/toxigen.yaml -> build/lib/lm_eval/tasks/toxigen 2026-09-01T00:15:55,619 copying lm_eval/tasks/eus_reading/eus_reading.yaml -> build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:15:55,622 copying lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,624 copying lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,626 copying lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,628 copying lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,630 copying lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,633 copying lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,635 copying lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,637 copying lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,639 copying lm_eval/tasks/ceval/_ceval-valid.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,642 copying lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,644 copying lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,646 copying lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,648 copying lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,650 copying lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,653 copying lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,655 copying lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,657 copying lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,660 copying lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,662 copying lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,664 copying lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,666 copying lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,668 copying lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,670 copying lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,672 copying lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,674 copying lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,676 copying lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,678 copying lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,681 copying lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,683 copying lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,685 copying lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,687 copying lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,689 copying lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,692 copying lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,694 copying lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,696 copying lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,699 copying lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,701 copying lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,704 copying lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,706 copying lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,708 copying lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,710 copying lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,712 copying lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,715 copying lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,717 copying lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,719 copying lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,722 copying lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,724 copying lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,726 copying lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,728 copying lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,731 copying lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,733 copying lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,735 copying lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,738 copying lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:15:55,740 creating build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,741 copying lm_eval/tasks/mela/mela_ja.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,743 copying lm_eval/tasks/mela/mela_ar.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,745 copying lm_eval/tasks/mela/mela_zh.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,747 copying lm_eval/tasks/mela/mela_de.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,749 copying lm_eval/tasks/mela/_mela.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,752 copying lm_eval/tasks/mela/mela_es.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,754 copying lm_eval/tasks/mela/mela_en.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,756 copying lm_eval/tasks/mela/mela_fr.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,758 copying lm_eval/tasks/mela/mela_is.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,761 copying lm_eval/tasks/mela/mela_ru.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,763 copying lm_eval/tasks/mela/mela_it.yaml -> build/lib/lm_eval/tasks/mela 2026-09-01T00:15:55,765 creating build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,766 copying lm_eval/tasks/aexams/aexams_Physics.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,769 copying lm_eval/tasks/aexams/aexams_Science.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,771 copying lm_eval/tasks/aexams/_aexams.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,773 copying lm_eval/tasks/aexams/aexams_Biology.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,776 copying lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,778 copying lm_eval/tasks/aexams/aexams_Social.yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:15:55,780 creating build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,781 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,783 copying lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,786 copying lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,788 copying lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,790 copying lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,793 copying lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,795 copying lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,797 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,799 copying lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,801 copying lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,803 copying lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,806 copying lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:15:55,808 creating build/lib/lm_eval/tasks/triviaqa 2026-09-01T00:15:55,809 copying lm_eval/tasks/triviaqa/default.yaml -> build/lib/lm_eval/tasks/triviaqa 2026-09-01T00:15:55,811 creating build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,812 copying lm_eval/tasks/haerae/haerae_lw.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,814 copying lm_eval/tasks/haerae/haerae_hi.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,816 copying lm_eval/tasks/haerae/haerae_gk.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,818 copying lm_eval/tasks/haerae/haerae_rw.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,821 copying lm_eval/tasks/haerae/_haerae.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,823 copying lm_eval/tasks/haerae/haerae_sn.yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:15:55,825 creating build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:15:55,826 copying lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:15:55,829 copying lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:15:55,831 copying lm_eval/tasks/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:15:55,833 copying lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:15:55,836 copying lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:15:55,838 copying lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:15:55,841 copying lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:15:55,843 copying lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:15:55,846 copying lm_eval/tasks/basqueglue/bhtc.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:55,848 copying lm_eval/tasks/basqueglue/bec.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:55,850 copying lm_eval/tasks/basqueglue/wic.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:55,852 copying lm_eval/tasks/basqueglue/coref.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:55,855 copying lm_eval/tasks/basqueglue/vaxx.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:55,857 copying lm_eval/tasks/basqueglue/qnli.yaml -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:15:55,859 copying lm_eval/tasks/coqa/default.yaml -> build/lib/lm_eval/tasks/coqa 2026-09-01T00:15:55,862 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2026-09-01T00:15:55,864 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,867 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,869 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,871 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,874 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,876 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,878 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,880 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,882 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,884 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,887 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,889 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,891 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,893 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,896 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,898 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,900 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:15:55,902 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,905 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,907 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,909 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,911 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,914 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,916 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,919 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,921 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,923 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,926 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,928 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,931 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,933 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,935 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,938 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,940 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:15:55,942 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,945 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,947 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,950 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,952 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,954 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,957 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,959 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,962 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,965 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,967 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,970 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,972 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,974 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,977 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,979 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,982 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:15:55,984 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:55,987 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:55,989 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:55,991 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:55,994 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:55,996 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:55,999 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,001 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,003 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,005 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,008 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,010 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,012 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,015 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,017 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,020 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,022 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:15:56,025 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,027 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,029 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,032 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,034 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,037 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,039 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,042 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,044 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,047 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,049 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,051 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,054 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,056 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,059 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,061 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,064 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:15:56,066 copying lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2026-09-01T00:15:56,069 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,071 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,073 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,076 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,078 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,080 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,083 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,085 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,087 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,090 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,092 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,094 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,097 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,099 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,101 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,104 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,106 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,108 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:15:56,111 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,113 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,115 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,118 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,120 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,123 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,125 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,127 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,130 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,132 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,134 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,136 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,139 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,141 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,144 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,146 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,148 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,151 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:15:56,153 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,156 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,158 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,160 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,163 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,165 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,168 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,170 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,172 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,175 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,177 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,180 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,182 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,184 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,187 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,189 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,192 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,194 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:15:56,197 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,199 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,201 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,204 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,206 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,208 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,211 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,213 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,216 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,218 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,221 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,223 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,225 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,228 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,230 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,233 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,235 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,237 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:15:56,240 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,242 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,245 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,247 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,250 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,252 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,255 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,257 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,260 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,262 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,264 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,267 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,269 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,272 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,274 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,276 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,279 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,281 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:15:56,283 creating build/lib/lm_eval/tasks/headqa 2026-09-01T00:15:56,284 copying lm_eval/tasks/headqa/headqa_en.yaml -> build/lib/lm_eval/tasks/headqa 2026-09-01T00:15:56,287 copying lm_eval/tasks/headqa/headqa_es.yaml -> build/lib/lm_eval/tasks/headqa 2026-09-01T00:15:56,290 copying lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:56,292 copying lm_eval/tasks/humaneval/humaneval.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:56,295 copying lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:56,297 copying lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:56,299 copying lm_eval/tasks/humaneval/humaneval_64.yaml -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:15:56,302 creating build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:15:56,303 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:15:56,306 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:15:56,308 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:15:56,311 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:15:56,314 copying lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:15:56,316 copying lm_eval/tasks/score/score_robustness.yaml -> build/lib/lm_eval/tasks/score 2026-09-01T00:15:56,319 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,321 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,324 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,326 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,329 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,332 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,334 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,336 copying lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,339 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,341 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,343 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,346 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,348 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,350 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,353 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,355 copying lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,357 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,360 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,362 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,365 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,367 copying lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,370 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,372 copying lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,374 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,377 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:15:56,380 copying lm_eval/tasks/score/math/score_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,382 copying lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,384 copying lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,387 copying lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,389 copying lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,391 copying lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,394 copying lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,396 copying lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,399 copying lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,401 copying lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,404 copying lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,406 copying lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,408 copying lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,410 copying lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,413 copying lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,415 copying lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,418 copying lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:15:56,420 copying lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:15:56,422 copying lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:15:56,425 copying lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:15:56,427 copying lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,430 copying lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,432 copying lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,434 copying lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,437 copying lm_eval/tasks/spanish_bench/copa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,439 copying lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,442 copying lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,444 copying lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,447 copying lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,449 copying lm_eval/tasks/spanish_bench/escola.yaml -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:15:56,452 copying lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,454 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,456 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,459 copying lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,461 copying lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,464 copying lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,466 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,468 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,471 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,473 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,476 copying lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,478 copying lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,480 copying lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,483 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,485 copying lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,487 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,490 copying lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:15:56,493 creating build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:15:56,494 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:15:56,497 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:15:56,499 copying lm_eval/tasks/careqa/careqa_en.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:56,501 copying lm_eval/tasks/careqa/careqa_es.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:56,504 copying lm_eval/tasks/careqa/careqa_open.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:56,506 copying lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:15:56,508 creating build/lib/lm_eval/tasks/piqa 2026-09-01T00:15:56,509 copying lm_eval/tasks/piqa/piqa.yaml -> build/lib/lm_eval/tasks/piqa 2026-09-01T00:15:56,512 copying lm_eval/tasks/global_piqa/_global_piqa_cloze.yaml -> build/lib/lm_eval/tasks/global_piqa 2026-09-01T00:15:56,515 copying lm_eval/tasks/global_piqa/_global_piqa_generation.yaml -> build/lib/lm_eval/tasks/global_piqa 2026-09-01T00:15:56,517 copying lm_eval/tasks/global_piqa/parallel_generation/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,519 copying lm_eval/tasks/global_piqa/parallel_generation/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,522 copying lm_eval/tasks/global_piqa/parallel_generation/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,524 copying lm_eval/tasks/global_piqa/parallel_generation/_global_piqa_parallel_generation.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,527 copying lm_eval/tasks/global_piqa/parallel_generation/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,529 copying lm_eval/tasks/global_piqa/parallel_generation/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,531 copying lm_eval/tasks/global_piqa/parallel_generation/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,533 copying lm_eval/tasks/global_piqa/parallel_generation/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,536 copying lm_eval/tasks/global_piqa/parallel_generation/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,538 copying lm_eval/tasks/global_piqa/parallel_generation/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,540 copying lm_eval/tasks/global_piqa/parallel_generation/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,543 copying lm_eval/tasks/global_piqa/parallel_generation/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,545 copying lm_eval/tasks/global_piqa/parallel_generation/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,547 copying lm_eval/tasks/global_piqa/parallel_generation/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,550 copying lm_eval/tasks/global_piqa/parallel_generation/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,552 copying lm_eval/tasks/global_piqa/parallel_generation/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,555 copying lm_eval/tasks/global_piqa/parallel_generation/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,557 copying lm_eval/tasks/global_piqa/parallel_generation/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,559 copying lm_eval/tasks/global_piqa/parallel_generation/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,562 copying lm_eval/tasks/global_piqa/parallel_generation/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,564 copying lm_eval/tasks/global_piqa/parallel_generation/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,566 copying lm_eval/tasks/global_piqa/parallel_generation/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,569 copying lm_eval/tasks/global_piqa/parallel_generation/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,571 copying lm_eval/tasks/global_piqa/parallel_generation/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,574 copying lm_eval/tasks/global_piqa/parallel_generation/mag_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,576 copying lm_eval/tasks/global_piqa/parallel_generation/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,578 copying lm_eval/tasks/global_piqa/parallel_generation/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,581 copying lm_eval/tasks/global_piqa/parallel_generation/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,583 copying lm_eval/tasks/global_piqa/parallel_generation/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,586 copying lm_eval/tasks/global_piqa/parallel_generation/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,588 copying lm_eval/tasks/global_piqa/parallel_generation/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,590 copying lm_eval/tasks/global_piqa/parallel_generation/xho_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,593 copying lm_eval/tasks/global_piqa/parallel_generation/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,595 copying lm_eval/tasks/global_piqa/parallel_generation/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,598 copying lm_eval/tasks/global_piqa/parallel_generation/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,600 copying lm_eval/tasks/global_piqa/parallel_generation/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,602 copying lm_eval/tasks/global_piqa/parallel_generation/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,605 copying lm_eval/tasks/global_piqa/parallel_generation/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,607 copying lm_eval/tasks/global_piqa/parallel_generation/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,609 copying lm_eval/tasks/global_piqa/parallel_generation/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,612 copying lm_eval/tasks/global_piqa/parallel_generation/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,614 copying lm_eval/tasks/global_piqa/parallel_generation/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,616 copying lm_eval/tasks/global_piqa/parallel_generation/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,619 copying lm_eval/tasks/global_piqa/parallel_generation/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,621 copying lm_eval/tasks/global_piqa/parallel_generation/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,623 copying lm_eval/tasks/global_piqa/parallel_generation/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,625 copying lm_eval/tasks/global_piqa/parallel_generation/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,628 copying lm_eval/tasks/global_piqa/parallel_generation/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,630 copying lm_eval/tasks/global_piqa/parallel_generation/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,632 copying lm_eval/tasks/global_piqa/parallel_generation/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,635 copying lm_eval/tasks/global_piqa/parallel_generation/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,637 copying lm_eval/tasks/global_piqa/parallel_generation/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,640 copying lm_eval/tasks/global_piqa/parallel_generation/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,642 copying lm_eval/tasks/global_piqa/parallel_generation/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,645 copying lm_eval/tasks/global_piqa/parallel_generation/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,647 copying lm_eval/tasks/global_piqa/parallel_generation/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,649 copying lm_eval/tasks/global_piqa/parallel_generation/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,651 copying lm_eval/tasks/global_piqa/parallel_generation/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,654 copying lm_eval/tasks/global_piqa/parallel_generation/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,656 copying lm_eval/tasks/global_piqa/parallel_generation/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,659 copying lm_eval/tasks/global_piqa/parallel_generation/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,661 copying lm_eval/tasks/global_piqa/parallel_generation/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,663 copying lm_eval/tasks/global_piqa/parallel_generation/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,666 copying lm_eval/tasks/global_piqa/parallel_generation/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,668 copying lm_eval/tasks/global_piqa/parallel_generation/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,670 copying lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,673 copying lm_eval/tasks/global_piqa/parallel_generation/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,675 copying lm_eval/tasks/global_piqa/parallel_generation/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,677 copying lm_eval/tasks/global_piqa/parallel_generation/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,679 copying lm_eval/tasks/global_piqa/parallel_generation/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,682 copying lm_eval/tasks/global_piqa/parallel_generation/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,684 copying lm_eval/tasks/global_piqa/parallel_generation/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,686 copying lm_eval/tasks/global_piqa/parallel_generation/ceb_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,689 copying lm_eval/tasks/global_piqa/parallel_generation/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,691 copying lm_eval/tasks/global_piqa/parallel_generation/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,693 copying lm_eval/tasks/global_piqa/parallel_generation/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,696 copying lm_eval/tasks/global_piqa/parallel_generation/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,698 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,700 copying lm_eval/tasks/global_piqa/parallel_generation/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,702 copying lm_eval/tasks/global_piqa/parallel_generation/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,705 copying lm_eval/tasks/global_piqa/parallel_generation/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,707 copying lm_eval/tasks/global_piqa/parallel_generation/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,709 copying lm_eval/tasks/global_piqa/parallel_generation/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,712 copying lm_eval/tasks/global_piqa/parallel_generation/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,714 copying lm_eval/tasks/global_piqa/parallel_generation/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,717 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,719 copying lm_eval/tasks/global_piqa/parallel_generation/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,722 copying lm_eval/tasks/global_piqa/parallel_generation/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,724 copying lm_eval/tasks/global_piqa/parallel_generation/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,726 copying lm_eval/tasks/global_piqa/parallel_generation/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,729 copying lm_eval/tasks/global_piqa/parallel_generation/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,731 copying lm_eval/tasks/global_piqa/parallel_generation/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,734 copying lm_eval/tasks/global_piqa/parallel_generation/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,736 copying lm_eval/tasks/global_piqa/parallel_generation/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,738 copying lm_eval/tasks/global_piqa/parallel_generation/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,741 copying lm_eval/tasks/global_piqa/parallel_generation/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,743 copying lm_eval/tasks/global_piqa/parallel_generation/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,745 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,748 copying lm_eval/tasks/global_piqa/parallel_generation/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,750 copying lm_eval/tasks/global_piqa/parallel_generation/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,752 copying lm_eval/tasks/global_piqa/parallel_generation/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,754 copying lm_eval/tasks/global_piqa/parallel_generation/bxr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,756 copying lm_eval/tasks/global_piqa/parallel_generation/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,759 copying lm_eval/tasks/global_piqa/parallel_generation/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,761 copying lm_eval/tasks/global_piqa/parallel_generation/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,763 copying lm_eval/tasks/global_piqa/parallel_generation/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,765 copying lm_eval/tasks/global_piqa/parallel_generation/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,767 copying lm_eval/tasks/global_piqa/parallel_generation/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,770 copying lm_eval/tasks/global_piqa/parallel_generation/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,772 copying lm_eval/tasks/global_piqa/parallel_generation/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,774 copying lm_eval/tasks/global_piqa/parallel_generation/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,776 copying lm_eval/tasks/global_piqa/parallel_generation/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,779 copying lm_eval/tasks/global_piqa/parallel_generation/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,781 copying lm_eval/tasks/global_piqa/parallel_generation/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,783 copying lm_eval/tasks/global_piqa/parallel_generation/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,785 copying lm_eval/tasks/global_piqa/parallel_generation/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,787 copying lm_eval/tasks/global_piqa/parallel_generation/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,790 copying lm_eval/tasks/global_piqa/parallel_generation/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,792 copying lm_eval/tasks/global_piqa/parallel_generation/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,794 copying lm_eval/tasks/global_piqa/parallel_generation/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,796 copying lm_eval/tasks/global_piqa/parallel_generation/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,798 copying lm_eval/tasks/global_piqa/parallel_generation/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,800 copying lm_eval/tasks/global_piqa/parallel_generation/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,803 copying lm_eval/tasks/global_piqa/parallel_generation/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,805 copying lm_eval/tasks/global_piqa/parallel_generation/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,807 copying lm_eval/tasks/global_piqa/parallel_generation/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,809 copying lm_eval/tasks/global_piqa/parallel_generation/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,811 copying lm_eval/tasks/global_piqa/parallel_generation/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,814 copying lm_eval/tasks/global_piqa/parallel_generation/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,816 copying lm_eval/tasks/global_piqa/parallel_generation/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,818 copying lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,821 copying lm_eval/tasks/global_piqa/parallel_generation/ilo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:15:56,823 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,825 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,827 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,829 copying lm_eval/tasks/global_piqa/nonparallel_cloze/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,832 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,834 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,836 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,838 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,841 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,843 copying lm_eval/tasks/global_piqa/nonparallel_cloze/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,845 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,848 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,850 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,852 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,855 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,857 copying lm_eval/tasks/global_piqa/nonparallel_cloze/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,859 copying lm_eval/tasks/global_piqa/nonparallel_cloze/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,861 copying lm_eval/tasks/global_piqa/nonparallel_cloze/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,863 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,866 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,868 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,870 copying lm_eval/tasks/global_piqa/nonparallel_cloze/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,872 copying lm_eval/tasks/global_piqa/nonparallel_cloze/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,874 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,876 copying lm_eval/tasks/global_piqa/nonparallel_cloze/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,878 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,881 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,883 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,885 copying lm_eval/tasks/global_piqa/nonparallel_cloze/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,888 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,890 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,892 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,895 copying lm_eval/tasks/global_piqa/nonparallel_cloze/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,897 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,900 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,902 copying lm_eval/tasks/global_piqa/nonparallel_cloze/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,905 copying lm_eval/tasks/global_piqa/nonparallel_cloze/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,907 copying lm_eval/tasks/global_piqa/nonparallel_cloze/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,909 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,911 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,914 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,916 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,918 copying lm_eval/tasks/global_piqa/nonparallel_cloze/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,920 copying lm_eval/tasks/global_piqa/nonparallel_cloze/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,922 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,925 copying lm_eval/tasks/global_piqa/nonparallel_cloze/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,927 copying lm_eval/tasks/global_piqa/nonparallel_cloze/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,929 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,931 copying lm_eval/tasks/global_piqa/nonparallel_cloze/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,934 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,936 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,938 copying lm_eval/tasks/global_piqa/nonparallel_cloze/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,940 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,942 copying lm_eval/tasks/global_piqa/nonparallel_cloze/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,945 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,947 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,949 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,951 copying lm_eval/tasks/global_piqa/nonparallel_cloze/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,954 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,956 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,958 copying lm_eval/tasks/global_piqa/nonparallel_cloze/_global_piqa_nonparallel_cloze.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,961 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,963 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,965 copying lm_eval/tasks/global_piqa/nonparallel_cloze/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,968 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,970 copying lm_eval/tasks/global_piqa/nonparallel_cloze/sun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,972 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,974 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,976 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,978 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,981 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,983 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,985 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,987 copying lm_eval/tasks/global_piqa/nonparallel_cloze/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,989 copying lm_eval/tasks/global_piqa/nonparallel_cloze/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,992 copying lm_eval/tasks/global_piqa/nonparallel_cloze/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,994 copying lm_eval/tasks/global_piqa/nonparallel_cloze/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,996 copying lm_eval/tasks/global_piqa/nonparallel_cloze/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:56,998 copying lm_eval/tasks/global_piqa/nonparallel_cloze/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,000 copying lm_eval/tasks/global_piqa/nonparallel_cloze/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,002 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,005 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,007 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,009 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,012 copying lm_eval/tasks/global_piqa/nonparallel_cloze/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,014 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,017 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,019 copying lm_eval/tasks/global_piqa/nonparallel_cloze/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,021 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,023 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,026 copying lm_eval/tasks/global_piqa/nonparallel_cloze/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,028 copying lm_eval/tasks/global_piqa/nonparallel_cloze/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,030 copying lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,033 copying lm_eval/tasks/global_piqa/nonparallel_cloze/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,035 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,038 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,040 copying lm_eval/tasks/global_piqa/nonparallel_cloze/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,042 copying lm_eval/tasks/global_piqa/nonparallel_cloze/dje_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,044 copying lm_eval/tasks/global_piqa/nonparallel_cloze/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,046 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,049 copying lm_eval/tasks/global_piqa/nonparallel_cloze/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,051 copying lm_eval/tasks/global_piqa/nonparallel_cloze/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,053 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,055 copying lm_eval/tasks/global_piqa/nonparallel_cloze/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,057 copying lm_eval/tasks/global_piqa/nonparallel_cloze/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,060 copying lm_eval/tasks/global_piqa/nonparallel_cloze/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,062 copying lm_eval/tasks/global_piqa/nonparallel_cloze/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,064 copying lm_eval/tasks/global_piqa/nonparallel_cloze/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,067 copying lm_eval/tasks/global_piqa/nonparallel_cloze/btx_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,069 copying lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,071 copying lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,073 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,076 copying lm_eval/tasks/global_piqa/nonparallel_cloze/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,078 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,080 copying lm_eval/tasks/global_piqa/nonparallel_cloze/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,083 copying lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,085 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,087 copying lm_eval/tasks/global_piqa/nonparallel_cloze/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,090 copying lm_eval/tasks/global_piqa/nonparallel_cloze/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,092 copying lm_eval/tasks/global_piqa/nonparallel_cloze/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,094 copying lm_eval/tasks/global_piqa/nonparallel_cloze/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,098 copying lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,100 copying lm_eval/tasks/global_piqa/nonparallel_cloze/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,103 copying lm_eval/tasks/global_piqa/nonparallel_cloze/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,105 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,107 copying lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,110 copying lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,112 copying lm_eval/tasks/global_piqa/nonparallel_cloze/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,114 copying lm_eval/tasks/global_piqa/nonparallel_cloze/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,117 copying lm_eval/tasks/global_piqa/nonparallel_cloze/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,119 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,121 copying lm_eval/tasks/global_piqa/nonparallel_cloze/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,123 copying lm_eval/tasks/global_piqa/nonparallel_cloze/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,126 copying lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,128 copying lm_eval/tasks/global_piqa/nonparallel_cloze/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,130 copying lm_eval/tasks/global_piqa/nonparallel_cloze/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,133 copying lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:15:57,135 copying lm_eval/tasks/global_piqa/parallel_cloze/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,137 copying lm_eval/tasks/global_piqa/parallel_cloze/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,139 copying lm_eval/tasks/global_piqa/parallel_cloze/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,142 copying lm_eval/tasks/global_piqa/parallel_cloze/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,144 copying lm_eval/tasks/global_piqa/parallel_cloze/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,146 copying lm_eval/tasks/global_piqa/parallel_cloze/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,148 copying lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,151 copying lm_eval/tasks/global_piqa/parallel_cloze/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,153 copying lm_eval/tasks/global_piqa/parallel_cloze/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,155 copying lm_eval/tasks/global_piqa/parallel_cloze/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,157 copying lm_eval/tasks/global_piqa/parallel_cloze/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,160 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,162 copying lm_eval/tasks/global_piqa/parallel_cloze/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,164 copying lm_eval/tasks/global_piqa/parallel_cloze/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,166 copying lm_eval/tasks/global_piqa/parallel_cloze/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,169 copying lm_eval/tasks/global_piqa/parallel_cloze/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,171 copying lm_eval/tasks/global_piqa/parallel_cloze/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,173 copying lm_eval/tasks/global_piqa/parallel_cloze/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,175 copying lm_eval/tasks/global_piqa/parallel_cloze/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,177 copying lm_eval/tasks/global_piqa/parallel_cloze/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,179 copying lm_eval/tasks/global_piqa/parallel_cloze/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,182 copying lm_eval/tasks/global_piqa/parallel_cloze/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,184 copying lm_eval/tasks/global_piqa/parallel_cloze/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,186 copying lm_eval/tasks/global_piqa/parallel_cloze/mag_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,188 copying lm_eval/tasks/global_piqa/parallel_cloze/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,190 copying lm_eval/tasks/global_piqa/parallel_cloze/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,193 copying lm_eval/tasks/global_piqa/parallel_cloze/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,195 copying lm_eval/tasks/global_piqa/parallel_cloze/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,197 copying lm_eval/tasks/global_piqa/parallel_cloze/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,199 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,202 copying lm_eval/tasks/global_piqa/parallel_cloze/xho_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,204 copying lm_eval/tasks/global_piqa/parallel_cloze/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,207 copying lm_eval/tasks/global_piqa/parallel_cloze/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,209 copying lm_eval/tasks/global_piqa/parallel_cloze/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,212 copying lm_eval/tasks/global_piqa/parallel_cloze/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,214 copying lm_eval/tasks/global_piqa/parallel_cloze/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,217 copying lm_eval/tasks/global_piqa/parallel_cloze/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,219 copying lm_eval/tasks/global_piqa/parallel_cloze/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,221 copying lm_eval/tasks/global_piqa/parallel_cloze/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,223 copying lm_eval/tasks/global_piqa/parallel_cloze/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,226 copying lm_eval/tasks/global_piqa/parallel_cloze/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,228 copying lm_eval/tasks/global_piqa/parallel_cloze/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,231 copying lm_eval/tasks/global_piqa/parallel_cloze/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,233 copying lm_eval/tasks/global_piqa/parallel_cloze/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,235 copying lm_eval/tasks/global_piqa/parallel_cloze/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,237 copying lm_eval/tasks/global_piqa/parallel_cloze/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,239 copying lm_eval/tasks/global_piqa/parallel_cloze/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,242 copying lm_eval/tasks/global_piqa/parallel_cloze/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,244 copying lm_eval/tasks/global_piqa/parallel_cloze/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,246 copying lm_eval/tasks/global_piqa/parallel_cloze/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,248 copying lm_eval/tasks/global_piqa/parallel_cloze/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,250 copying lm_eval/tasks/global_piqa/parallel_cloze/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,253 copying lm_eval/tasks/global_piqa/parallel_cloze/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,255 copying lm_eval/tasks/global_piqa/parallel_cloze/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,257 copying lm_eval/tasks/global_piqa/parallel_cloze/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,259 copying lm_eval/tasks/global_piqa/parallel_cloze/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,262 copying lm_eval/tasks/global_piqa/parallel_cloze/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,264 copying lm_eval/tasks/global_piqa/parallel_cloze/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,266 copying lm_eval/tasks/global_piqa/parallel_cloze/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,269 copying lm_eval/tasks/global_piqa/parallel_cloze/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,271 copying lm_eval/tasks/global_piqa/parallel_cloze/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,273 copying lm_eval/tasks/global_piqa/parallel_cloze/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,275 copying lm_eval/tasks/global_piqa/parallel_cloze/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,278 copying lm_eval/tasks/global_piqa/parallel_cloze/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,280 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,282 copying lm_eval/tasks/global_piqa/parallel_cloze/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,285 copying lm_eval/tasks/global_piqa/parallel_cloze/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,287 copying lm_eval/tasks/global_piqa/parallel_cloze/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,289 copying lm_eval/tasks/global_piqa/parallel_cloze/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,292 copying lm_eval/tasks/global_piqa/parallel_cloze/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,294 copying lm_eval/tasks/global_piqa/parallel_cloze/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,296 copying lm_eval/tasks/global_piqa/parallel_cloze/ceb_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,298 copying lm_eval/tasks/global_piqa/parallel_cloze/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,300 copying lm_eval/tasks/global_piqa/parallel_cloze/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,303 copying lm_eval/tasks/global_piqa/parallel_cloze/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,305 copying lm_eval/tasks/global_piqa/parallel_cloze/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,307 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,309 copying lm_eval/tasks/global_piqa/parallel_cloze/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,312 copying lm_eval/tasks/global_piqa/parallel_cloze/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,314 copying lm_eval/tasks/global_piqa/parallel_cloze/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,316 copying lm_eval/tasks/global_piqa/parallel_cloze/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,318 copying lm_eval/tasks/global_piqa/parallel_cloze/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,320 copying lm_eval/tasks/global_piqa/parallel_cloze/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,323 copying lm_eval/tasks/global_piqa/parallel_cloze/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,325 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,327 copying lm_eval/tasks/global_piqa/parallel_cloze/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,329 copying lm_eval/tasks/global_piqa/parallel_cloze/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,331 copying lm_eval/tasks/global_piqa/parallel_cloze/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,334 copying lm_eval/tasks/global_piqa/parallel_cloze/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,336 copying lm_eval/tasks/global_piqa/parallel_cloze/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,338 copying lm_eval/tasks/global_piqa/parallel_cloze/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,340 copying lm_eval/tasks/global_piqa/parallel_cloze/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,343 copying lm_eval/tasks/global_piqa/parallel_cloze/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,345 copying lm_eval/tasks/global_piqa/parallel_cloze/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,347 copying lm_eval/tasks/global_piqa/parallel_cloze/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,350 copying lm_eval/tasks/global_piqa/parallel_cloze/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,352 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,354 copying lm_eval/tasks/global_piqa/parallel_cloze/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,356 copying lm_eval/tasks/global_piqa/parallel_cloze/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,359 copying lm_eval/tasks/global_piqa/parallel_cloze/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,361 copying lm_eval/tasks/global_piqa/parallel_cloze/bxr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,363 copying lm_eval/tasks/global_piqa/parallel_cloze/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,365 copying lm_eval/tasks/global_piqa/parallel_cloze/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,367 copying lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,369 copying lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,371 copying lm_eval/tasks/global_piqa/parallel_cloze/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,373 copying lm_eval/tasks/global_piqa/parallel_cloze/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,375 copying lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,378 copying lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,380 copying lm_eval/tasks/global_piqa/parallel_cloze/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,382 copying lm_eval/tasks/global_piqa/parallel_cloze/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,384 copying lm_eval/tasks/global_piqa/parallel_cloze/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,387 copying lm_eval/tasks/global_piqa/parallel_cloze/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,389 copying lm_eval/tasks/global_piqa/parallel_cloze/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,391 copying lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,393 copying lm_eval/tasks/global_piqa/parallel_cloze/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,395 copying lm_eval/tasks/global_piqa/parallel_cloze/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,398 copying lm_eval/tasks/global_piqa/parallel_cloze/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,400 copying lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,402 copying lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,404 copying lm_eval/tasks/global_piqa/parallel_cloze/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,406 copying lm_eval/tasks/global_piqa/parallel_cloze/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,409 copying lm_eval/tasks/global_piqa/parallel_cloze/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,411 copying lm_eval/tasks/global_piqa/parallel_cloze/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,413 copying lm_eval/tasks/global_piqa/parallel_cloze/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,415 copying lm_eval/tasks/global_piqa/parallel_cloze/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,417 copying lm_eval/tasks/global_piqa/parallel_cloze/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,420 copying lm_eval/tasks/global_piqa/parallel_cloze/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,422 copying lm_eval/tasks/global_piqa/parallel_cloze/_global_piqa_parallel_cloze.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,424 copying lm_eval/tasks/global_piqa/parallel_cloze/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,427 copying lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,429 copying lm_eval/tasks/global_piqa/parallel_cloze/ilo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:15:57,431 copying lm_eval/tasks/global_piqa/nonparallel_generation/ben_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,433 copying lm_eval/tasks/global_piqa/nonparallel_generation/cat_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,435 copying lm_eval/tasks/global_piqa/nonparallel_generation/ita_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,437 copying lm_eval/tasks/global_piqa/nonparallel_generation/vie_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,439 copying lm_eval/tasks/global_piqa/nonparallel_generation/ell_grek.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,441 copying lm_eval/tasks/global_piqa/nonparallel_generation/ary_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,444 copying lm_eval/tasks/global_piqa/nonparallel_generation/ckb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,446 copying lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_fran.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,448 copying lm_eval/tasks/global_piqa/nonparallel_generation/ars_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,450 copying lm_eval/tasks/global_piqa/nonparallel_generation/afb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,452 copying lm_eval/tasks/global_piqa/nonparallel_generation/mar_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,455 copying lm_eval/tasks/global_piqa/nonparallel_generation/mni_mtei.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,457 copying lm_eval/tasks/global_piqa/nonparallel_generation/tam_taml.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,459 copying lm_eval/tasks/global_piqa/nonparallel_generation/kaz_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,461 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,463 copying lm_eval/tasks/global_piqa/nonparallel_generation/eus_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,466 copying lm_eval/tasks/global_piqa/nonparallel_generation/acm_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,468 copying lm_eval/tasks/global_piqa/nonparallel_generation/snd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,470 copying lm_eval/tasks/global_piqa/nonparallel_generation/tel_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,472 copying lm_eval/tasks/global_piqa/nonparallel_generation/pan_guru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,475 copying lm_eval/tasks/global_piqa/nonparallel_generation/bel_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,477 copying lm_eval/tasks/global_piqa/nonparallel_generation/jav_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,479 copying lm_eval/tasks/global_piqa/nonparallel_generation/zul_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,481 copying lm_eval/tasks/global_piqa/nonparallel_generation/kan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,483 copying lm_eval/tasks/global_piqa/nonparallel_generation/swe_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,486 copying lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hans.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,488 copying lm_eval/tasks/global_piqa/nonparallel_generation/kor_hang.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,490 copying lm_eval/tasks/global_piqa/nonparallel_generation/ces_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,492 copying lm_eval/tasks/global_piqa/nonparallel_generation/yue_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,494 copying lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hant.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,496 copying lm_eval/tasks/global_piqa/nonparallel_generation/ekk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,499 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,501 copying lm_eval/tasks/global_piqa/nonparallel_generation/heb_hebr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,503 copying lm_eval/tasks/global_piqa/nonparallel_generation/kin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,506 copying lm_eval/tasks/global_piqa/nonparallel_generation/bsk_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,508 copying lm_eval/tasks/global_piqa/nonparallel_generation/snd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,510 copying lm_eval/tasks/global_piqa/nonparallel_generation/als_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,512 copying lm_eval/tasks/global_piqa/nonparallel_generation/npi_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,515 copying lm_eval/tasks/global_piqa/nonparallel_generation/bgc_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,517 copying lm_eval/tasks/global_piqa/nonparallel_generation/tel_telu.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,519 copying lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,522 copying lm_eval/tasks/global_piqa/nonparallel_generation/ekp_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,524 copying lm_eval/tasks/global_piqa/nonparallel_generation/lin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,526 copying lm_eval/tasks/global_piqa/nonparallel_generation/azj_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,528 copying lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn_sari.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,531 copying lm_eval/tasks/global_piqa/nonparallel_generation/luo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,533 copying lm_eval/tasks/global_piqa/nonparallel_generation/isl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,535 copying lm_eval/tasks/global_piqa/nonparallel_generation/fin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,538 copying lm_eval/tasks/global_piqa/nonparallel_generation/asm_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,540 copying lm_eval/tasks/global_piqa/nonparallel_generation/hrv_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,542 copying lm_eval/tasks/global_piqa/nonparallel_generation/nno_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,544 copying lm_eval/tasks/global_piqa/nonparallel_generation/arb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,546 copying lm_eval/tasks/global_piqa/nonparallel_generation/ckm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,548 copying lm_eval/tasks/global_piqa/nonparallel_generation/urd_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,551 copying lm_eval/tasks/global_piqa/nonparallel_generation/nob_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,553 copying lm_eval/tasks/global_piqa/nonparallel_generation/ron_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,555 copying lm_eval/tasks/global_piqa/nonparallel_generation/nld_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,557 copying lm_eval/tasks/global_piqa/nonparallel_generation/yor_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,560 copying lm_eval/tasks/global_piqa/nonparallel_generation/hin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,562 copying lm_eval/tasks/global_piqa/nonparallel_generation/mkd_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,564 copying lm_eval/tasks/global_piqa/nonparallel_generation/fao_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,567 copying lm_eval/tasks/global_piqa/nonparallel_generation/hye_armn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,569 copying lm_eval/tasks/global_piqa/nonparallel_generation/rus_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,571 copying lm_eval/tasks/global_piqa/nonparallel_generation/_global_piqa_nonparallel_generation.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,574 copying lm_eval/tasks/global_piqa/nonparallel_generation/hun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,577 copying lm_eval/tasks/global_piqa/nonparallel_generation/sun_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,579 copying lm_eval/tasks/global_piqa/nonparallel_generation/tha_thai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,581 copying lm_eval/tasks/global_piqa/nonparallel_generation/bul_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,583 copying lm_eval/tasks/global_piqa/nonparallel_generation/hau_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,586 copying lm_eval/tasks/global_piqa/nonparallel_generation/bra_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,588 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl_torl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,590 copying lm_eval/tasks/global_piqa/nonparallel_generation/kir_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,593 copying lm_eval/tasks/global_piqa/nonparallel_generation/bcc_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,595 copying lm_eval/tasks/global_piqa/nonparallel_generation/swv_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,597 copying lm_eval/tasks/global_piqa/nonparallel_generation/swh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,599 copying lm_eval/tasks/global_piqa/nonparallel_generation/arq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,601 copying lm_eval/tasks/global_piqa/nonparallel_generation/plt_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,603 copying lm_eval/tasks/global_piqa/nonparallel_generation/haw_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,605 copying lm_eval/tasks/global_piqa/nonparallel_generation/dhd_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,607 copying lm_eval/tasks/global_piqa/nonparallel_generation/glg_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,610 copying lm_eval/tasks/global_piqa/nonparallel_generation/mni_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,612 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_leba.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,614 copying lm_eval/tasks/global_piqa/nonparallel_generation/ibo_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,617 copying lm_eval/tasks/global_piqa/nonparallel_generation/ben_beng.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,619 copying lm_eval/tasks/global_piqa/nonparallel_generation/zsm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,621 copying lm_eval/tasks/global_piqa/nonparallel_generation/kat_geor.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,623 copying lm_eval/tasks/global_piqa/nonparallel_generation/ory_orya.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,626 copying lm_eval/tasks/global_piqa/nonparallel_generation/mal_mlym.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,628 copying lm_eval/tasks/global_piqa/nonparallel_generation/bho_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,630 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_jord.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,632 copying lm_eval/tasks/global_piqa/nonparallel_generation/aeb_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,635 copying lm_eval/tasks/global_piqa/nonparallel_generation/iso_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,637 copying lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_port.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,640 copying lm_eval/tasks/global_piqa/nonparallel_generation/deu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,642 copying lm_eval/tasks/global_piqa/nonparallel_generation/ind_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,644 copying lm_eval/tasks/global_piqa/nonparallel_generation/tam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,647 copying lm_eval/tasks/global_piqa/nonparallel_generation/eng_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,649 copying lm_eval/tasks/global_piqa/nonparallel_generation/dje_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,652 copying lm_eval/tasks/global_piqa/nonparallel_generation/jpn_jpan.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,654 copying lm_eval/tasks/global_piqa/nonparallel_generation/bam_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,656 copying lm_eval/tasks/global_piqa/nonparallel_generation/ukr_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,659 copying lm_eval/tasks/global_piqa/nonparallel_generation/dan_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,661 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_syri.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,663 copying lm_eval/tasks/global_piqa/nonparallel_generation/lit_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,665 copying lm_eval/tasks/global_piqa/nonparallel_generation/guj_gujr.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,668 copying lm_eval/tasks/global_piqa/nonparallel_generation/sin_sinh.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,680 copying lm_eval/tasks/global_piqa/nonparallel_generation/urh_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,682 copying lm_eval/tasks/global_piqa/nonparallel_generation/cls_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,685 copying lm_eval/tasks/global_piqa/nonparallel_generation/btx_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,687 copying lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_mexi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,689 copying lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_pale.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,691 copying lm_eval/tasks/global_piqa/nonparallel_generation/tur_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,694 copying lm_eval/tasks/global_piqa/nonparallel_generation/hin_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,696 copying lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_prle.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,698 copying lm_eval/tasks/global_piqa/nonparallel_generation/bos_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,701 copying lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_spai.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,703 copying lm_eval/tasks/global_piqa/nonparallel_generation/pes_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,705 copying lm_eval/tasks/global_piqa/nonparallel_generation/kan_knda.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,707 copying lm_eval/tasks/global_piqa/nonparallel_generation/arz_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,709 copying lm_eval/tasks/global_piqa/nonparallel_generation/uzn_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,712 copying lm_eval/tasks/global_piqa/nonparallel_generation/tgl_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,714 copying lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_cana.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,716 copying lm_eval/tasks/global_piqa/nonparallel_generation/amh_ethi.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,719 copying lm_eval/tasks/global_piqa/nonparallel_generation/nag_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,721 copying lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,723 copying lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_cerk.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,725 copying lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_peru.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,728 copying lm_eval/tasks/global_piqa/nonparallel_generation/idu_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,730 copying lm_eval/tasks/global_piqa/nonparallel_generation/sin_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,733 copying lm_eval/tasks/global_piqa/nonparallel_generation/urd_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,735 copying lm_eval/tasks/global_piqa/nonparallel_generation/pcm_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,737 copying lm_eval/tasks/global_piqa/nonparallel_generation/rwr_deva.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,739 copying lm_eval/tasks/global_piqa/nonparallel_generation/uig_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,742 copying lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_braz.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,744 copying lm_eval/tasks/global_piqa/nonparallel_generation/pol_latn.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,746 copying lm_eval/tasks/global_piqa/nonparallel_generation/acq_arab.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,748 copying lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl.yaml -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:15:57,751 copying lm_eval/tasks/drop/default.yaml -> build/lib/lm_eval/tasks/drop 2026-09-01T00:15:57,753 creating build/lib/lm_eval/tasks/storycloze 2026-09-01T00:15:57,754 copying lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/lib/lm_eval/tasks/storycloze 2026-09-01T00:15:57,756 copying lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/lib/lm_eval/tasks/storycloze 2026-09-01T00:15:57,758 creating build/lib/lm_eval/tasks/nq_open 2026-09-01T00:15:57,759 copying lm_eval/tasks/nq_open/nq_open.yaml -> build/lib/lm_eval/tasks/nq_open 2026-09-01T00:15:57,762 copying lm_eval/tasks/indicparam/indicparam_oriya.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,764 copying lm_eval/tasks/indicparam/indicparam_rajasthani.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,766 copying lm_eval/tasks/indicparam/_indicparam.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,769 copying lm_eval/tasks/indicparam/indicparam_gujarati.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,771 copying lm_eval/tasks/indicparam/indicparam_sanskrit.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,773 copying lm_eval/tasks/indicparam/indicparam_dogri.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,776 copying lm_eval/tasks/indicparam/indicparam_santali.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,778 copying lm_eval/tasks/indicparam/indicparam_sanskrit_mix.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,780 copying lm_eval/tasks/indicparam/indicparam_maithili.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,782 copying lm_eval/tasks/indicparam/indicparam_konkani.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,785 copying lm_eval/tasks/indicparam/indicparam_bodo.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,787 copying lm_eval/tasks/indicparam/indicparam_nepali.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,789 copying lm_eval/tasks/indicparam/indicparam_marathi.yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:15:57,792 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,794 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_javascript.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,796 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_biorxiv_all.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,798 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_other.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,800 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_english.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,802 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_nonenglish.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,805 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_bbc_news.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,807 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_markdown.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,809 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_nonenglish.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,811 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_cpp.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,813 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_python.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,816 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_english.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,818 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_physics.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,821 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_other.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,823 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_cs.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,825 copying lm_eval/tasks/uncheatable_eval/_uncheatable_eval_base.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,827 copying lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_math.yaml -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:15:57,829 creating build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:15:57,831 copying lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:15:57,833 creating build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,834 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,837 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,839 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,841 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,844 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,846 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,848 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,851 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,853 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,855 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,857 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,859 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,861 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,864 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,866 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,868 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,870 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,872 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,874 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,877 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,879 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,881 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,883 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,886 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,888 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,890 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,892 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,895 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,897 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,899 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,901 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,904 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,906 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,908 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,911 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,913 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,915 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,917 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,919 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,921 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,924 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,926 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,928 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,930 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,933 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,935 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,938 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,940 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,942 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,944 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,947 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,949 copying lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,951 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,954 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,956 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,959 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,961 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,963 copying lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:15:57,966 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:15:57,968 copying lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:15:57,971 copying lm_eval/tasks/webqs/webqs.yaml -> build/lib/lm_eval/tasks/webqs 2026-09-01T00:15:57,973 creating build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:15:57,974 copying lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:15:57,976 copying lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:15:57,979 copying lm_eval/tasks/logiqa2/logieval.yaml -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:15:57,981 copying lm_eval/tasks/logiqa2/logiqa2.yaml -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:15:57,984 copying lm_eval/tasks/afrobench/afrobench.yaml -> build/lib/lm_eval/tasks/afrobench 2026-09-01T00:15:57,986 copying lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/lib/lm_eval/tasks/afrobench 2026-09-01T00:15:57,989 copying lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:15:57,991 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:15:57,992 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:15:57,994 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:15:57,996 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:15:57,998 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:15:58,001 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:15:58,003 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:15:58,004 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:15:58,007 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:15:58,009 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:15:58,012 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:15:58,014 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:15:58,016 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:15:58,018 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:15:58,020 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:15:58,022 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:15:58,025 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:15:58,027 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:15:58,029 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:15:58,030 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:15:58,033 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:15:58,035 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:15:58,037 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:15:58,039 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:15:58,041 creating build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:15:58,042 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:15:58,045 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:15:58,047 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:15:58,049 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:15:58,052 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:15:58,054 copying lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:15:58,057 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,059 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,062 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,064 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,066 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,069 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,071 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:15:58,073 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,076 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,078 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,080 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,082 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,084 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,087 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:15:58,089 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,092 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,094 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,097 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,099 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,102 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,104 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:15:58,106 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,108 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,110 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,113 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,115 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,117 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,119 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:15:58,122 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,124 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,126 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,129 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,131 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,133 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,136 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:15:58,138 copying lm_eval/tasks/afrobench/salt/salt.yaml -> build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:15:58,140 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,141 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,143 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,146 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,148 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,150 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,153 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,155 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,157 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,159 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,162 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,164 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,166 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,169 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,171 copying lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:15:58,173 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,174 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,176 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,178 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,180 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,183 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,185 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,187 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,189 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,191 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,194 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,196 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,198 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,200 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,202 copying lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:15:58,204 creating build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,205 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,208 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,210 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,212 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,214 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,217 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,219 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,221 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,223 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,226 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,228 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,230 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,232 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,234 copying lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:15:58,237 copying lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:15:58,239 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,240 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,243 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,245 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,247 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,250 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,252 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,254 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,256 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,259 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,261 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,263 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,265 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,268 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,270 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,272 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,274 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,277 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,279 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,282 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,284 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,286 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,288 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,290 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,293 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,295 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,297 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,299 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,301 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,304 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,306 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,308 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:15:58,310 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,311 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,313 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,316 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,318 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,320 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,323 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,325 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,327 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,329 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,332 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,334 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,336 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,338 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,341 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,343 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,345 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,347 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,350 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,352 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,354 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,356 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,358 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,360 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,362 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,365 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,367 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,369 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,371 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,374 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,376 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,378 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:15:58,380 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,381 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,383 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,386 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,388 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,390 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,393 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,395 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,397 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,399 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,402 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,404 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,407 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,409 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,411 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,413 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,416 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,418 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,420 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,423 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,426 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,428 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,430 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,432 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,435 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,437 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,439 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,441 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,444 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,446 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,448 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,450 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:15:58,453 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,454 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,456 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,458 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,461 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,463 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,465 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,467 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,470 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,472 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,474 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,476 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,478 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,480 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,483 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,485 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,487 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,490 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,492 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,494 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,497 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,499 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,501 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,504 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,506 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,508 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,511 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,513 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,515 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,518 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,520 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,522 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:15:58,524 creating build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,526 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,528 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,530 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,533 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,535 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,537 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,539 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,541 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,544 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,546 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,548 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,550 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,552 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,554 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,557 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,559 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,561 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,563 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,566 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,568 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,570 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,572 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,575 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,577 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,579 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,581 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,584 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,586 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,588 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,591 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,593 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:15:58,595 copying lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:15:58,597 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,600 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,602 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,604 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,606 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,609 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,611 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,613 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,615 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,618 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,620 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,623 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,625 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,627 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,630 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,632 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,634 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,637 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,639 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,641 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:15:58,644 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,646 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,649 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,651 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,653 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,656 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,658 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,660 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,662 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,665 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,667 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,669 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,672 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,674 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,676 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,678 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,681 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,683 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,685 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,688 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:15:58,690 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,692 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,695 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,697 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,699 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,701 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,704 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,706 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,708 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,710 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,713 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,715 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,717 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,719 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,722 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,724 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,726 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,729 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,731 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,733 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:15:58,736 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,738 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,740 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,743 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,745 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,747 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,749 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,752 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,754 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,757 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,759 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,762 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,764 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,766 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,769 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,771 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,773 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,776 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,778 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,780 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:15:58,783 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,785 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,788 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,790 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,792 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,794 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,796 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,799 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,801 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,803 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,806 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,808 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,810 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,813 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,815 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,818 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,820 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,822 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,825 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,827 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:15:58,830 copying lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:15:58,832 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,835 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,838 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,840 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,842 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,844 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,847 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,849 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,851 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,854 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,856 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,858 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,861 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,863 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,865 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,868 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,870 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:15:58,873 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,875 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,878 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,880 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,883 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,885 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,888 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,890 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,892 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,895 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,897 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,900 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,902 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,904 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,907 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,909 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,912 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:15:58,914 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,917 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,919 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,921 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,924 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,926 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,928 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,931 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,933 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,936 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,938 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,941 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,943 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,945 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,948 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,950 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,953 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:15:58,956 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,958 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,960 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,963 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,965 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,968 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,970 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,972 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,975 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,977 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,980 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,982 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,984 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,987 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,989 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,992 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,994 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:15:58,997 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:58,999 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,002 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,004 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,007 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,009 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,012 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,014 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,017 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,019 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,022 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,024 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,026 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,029 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,031 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,033 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,036 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:15:59,038 copying lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:15:59,041 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,043 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,046 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,048 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,051 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,053 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,055 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,058 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,060 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,062 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,065 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,067 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,070 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,072 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,075 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,077 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:15:59,080 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,082 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,084 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,087 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,089 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,092 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,094 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,097 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,099 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,101 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,103 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,106 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,108 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,111 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,113 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,115 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:15:59,118 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,120 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,122 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,124 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,127 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,129 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,131 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,134 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,136 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,138 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,140 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,143 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,145 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,147 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,149 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,151 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:15:59,153 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,156 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,158 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,160 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,162 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,164 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,166 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,168 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,171 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,173 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,175 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,177 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,179 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,181 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,184 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,186 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:15:59,188 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,190 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,192 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,195 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,197 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,199 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,201 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,203 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,205 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,207 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,209 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,211 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,214 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,216 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,218 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,221 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:15:59,223 copying lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:15:59,225 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,227 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,229 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,231 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,234 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,236 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,238 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,240 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,242 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:15:59,244 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,247 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,249 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,251 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,253 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,256 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,258 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,260 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,262 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:15:59,264 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,266 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,268 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,270 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,272 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,274 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,277 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,279 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,281 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:15:59,283 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,285 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,288 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,290 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,293 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,295 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,298 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,301 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,303 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:15:59,306 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,308 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,310 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,312 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,315 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,317 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,319 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,322 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,324 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:15:59,326 copying lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:15:59,329 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,331 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,333 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,335 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,338 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,340 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,342 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,344 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,346 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,349 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,351 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,353 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,355 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,358 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,360 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,362 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,364 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,367 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,369 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,371 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,373 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:15:59,376 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,378 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,380 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,382 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,385 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,387 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,389 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,391 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,393 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,396 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,398 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,400 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,402 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,404 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,407 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,409 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,411 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,413 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,416 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,418 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,420 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:15:59,423 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,425 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,428 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,430 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,432 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,435 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,437 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,439 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,441 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,444 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,446 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,448 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,451 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,453 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,455 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,458 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,460 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,463 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,465 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,467 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,470 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:15:59,472 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,475 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,477 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,480 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,482 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,484 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,487 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,489 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,491 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,494 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,496 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,498 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,501 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,503 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,505 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,508 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,510 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,512 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,515 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,517 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,519 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:15:59,522 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,524 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,527 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,529 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,531 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,534 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,536 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,539 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,541 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,543 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,546 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,548 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,550 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,553 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,555 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,557 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,560 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,562 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,564 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,567 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,569 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:15:59,572 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,574 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,577 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,579 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,582 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,584 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,586 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,589 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,591 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,594 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,596 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,598 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,600 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,603 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,605 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,607 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,609 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,611 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,614 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,616 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,618 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:15:59,621 copying lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:15:59,623 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,627 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,629 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,632 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,635 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,637 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,640 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,644 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,647 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,649 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,652 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,655 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,657 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,659 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:15:59,662 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,664 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,667 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,669 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,672 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,674 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,677 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,679 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,682 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,684 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,687 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,689 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,692 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,694 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:15:59,696 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,699 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,701 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,704 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,706 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,709 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,711 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,714 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,716 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,719 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,721 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,724 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,726 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,729 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:15:59,732 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,734 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,737 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,740 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,742 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,745 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,747 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,750 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,752 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,755 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,757 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,760 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,763 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,765 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:15:59,768 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,770 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,773 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,775 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,778 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,780 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,783 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,785 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,788 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,790 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,793 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,795 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,797 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,800 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:15:59,802 copying lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:15:59,804 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,806 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,809 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,811 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,813 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,816 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,818 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,821 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,823 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,826 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,828 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,830 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,833 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,836 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,838 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,840 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,843 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,846 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,848 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,851 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,853 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,856 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,858 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,861 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,863 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,866 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,868 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,871 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,873 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,876 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,879 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,881 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,884 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:15:59,886 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,887 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,890 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,892 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,894 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,897 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,899 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,902 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,904 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,907 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,909 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,912 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,914 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,917 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,920 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,922 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,924 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,927 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,929 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,932 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,934 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,937 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,939 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,942 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,944 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,947 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,949 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,952 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,954 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,957 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,960 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,962 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,964 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:15:59,967 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,968 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,971 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,974 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,976 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,978 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,981 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,983 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,986 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,988 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,991 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,993 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,996 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:15:59,998 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,001 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,003 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,006 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,008 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,011 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,013 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,016 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,018 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,020 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,023 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,025 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,028 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,030 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,033 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,035 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,038 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,040 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,043 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,045 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:00,047 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,049 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,051 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,054 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,056 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,059 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,061 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,063 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,066 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,069 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,071 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,073 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,076 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,078 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,081 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,083 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,086 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,088 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,091 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,093 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,096 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,098 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,101 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,103 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,106 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,108 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,111 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,113 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,116 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,118 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,121 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,124 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,126 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:00,128 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,130 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,133 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,135 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,138 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,140 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,142 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,145 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,147 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,150 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,153 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,155 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,158 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,160 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,162 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,165 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,167 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,170 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,172 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,175 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,177 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,180 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,182 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,184 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,187 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,189 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,191 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,194 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,196 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,199 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,201 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,203 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,206 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:00,208 creating build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,209 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,212 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,214 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,216 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,219 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,221 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,223 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,226 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,228 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,231 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,233 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,236 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,238 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,241 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,243 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,246 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,248 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,251 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,254 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,256 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,259 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,261 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,263 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,266 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,268 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,271 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,273 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,276 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,278 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,281 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,283 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,286 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:00,288 copying lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:16:00,291 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:00,293 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:00,295 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:00,298 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:00,300 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:00,303 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:00,305 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:00,307 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:00,310 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:00,312 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:00,315 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:00,317 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:00,320 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:00,322 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:00,324 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:00,327 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:00,329 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:00,332 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:00,334 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:00,337 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:00,339 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:00,342 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:00,344 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:00,347 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:00,349 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:00,352 copying lm_eval/tasks/afrobench/flores/flores.yaml -> build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:16:00,354 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,356 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,358 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,361 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,363 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,366 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,368 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,370 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,373 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,375 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,378 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,380 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,383 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,385 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,388 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,390 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,392 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,394 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,397 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,399 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,401 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,404 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,406 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,408 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,411 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,413 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,416 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,418 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,421 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,423 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,425 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,427 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,430 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,432 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,434 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,437 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,439 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,442 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,444 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,447 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,450 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,452 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,455 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,458 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,460 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,463 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,465 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,467 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,470 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,472 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,474 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,477 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,479 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,482 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,484 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,486 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,489 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,492 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,494 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,496 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,499 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,502 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,504 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:00,506 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,508 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,510 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,512 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,514 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,517 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,519 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,522 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,524 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,526 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,528 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,530 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,533 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,535 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,537 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,540 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,542 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,544 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,546 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,549 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,551 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,553 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,556 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,558 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,560 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,562 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,565 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,567 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,569 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,571 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,574 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,576 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,578 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,580 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,583 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,585 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,587 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,590 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,592 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,594 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,596 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,599 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,601 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,603 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,606 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,608 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,610 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,613 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,615 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,617 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,619 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,621 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,624 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,626 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,628 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,630 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,633 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,635 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,637 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,640 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,642 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,644 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,646 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:00,649 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,651 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,653 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,655 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,658 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,660 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,662 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,665 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,667 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,669 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,672 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,674 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,676 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,678 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,681 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,683 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,685 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,688 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,690 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,692 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,694 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,697 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,699 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,702 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,704 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,706 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,709 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,711 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,713 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,716 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,718 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,720 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,722 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,725 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,727 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,729 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,732 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,734 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,736 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,739 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,741 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,744 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,747 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,750 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,753 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,756 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,758 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,761 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,764 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,767 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,769 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,772 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,775 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,778 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,780 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,783 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,786 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,789 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,792 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,794 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,797 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,800 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,803 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:00,806 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,807 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,810 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,813 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,816 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,819 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,822 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,824 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,827 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,830 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,832 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,835 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,838 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,841 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,843 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,846 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,848 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,850 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,853 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,855 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,857 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,859 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,861 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,864 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,866 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,868 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,871 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,873 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,876 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,878 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,880 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,883 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,885 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,888 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,890 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,892 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,895 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,897 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,899 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,902 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,904 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,907 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,909 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,912 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,914 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,916 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,919 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,921 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,924 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,926 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,929 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,931 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,933 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,936 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,938 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,940 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,943 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,945 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,947 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,950 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,952 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,955 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,957 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:00,960 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,961 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,964 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,966 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,969 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,971 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,974 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,976 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,979 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,981 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,984 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,986 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,988 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,991 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,993 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,995 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:00,998 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,000 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,002 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,005 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,007 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,009 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,012 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,014 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,017 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,019 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,022 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,024 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,027 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,029 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,031 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,034 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,036 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,038 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,040 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,043 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,045 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,047 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,050 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,052 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,054 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,057 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,059 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,061 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,064 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,066 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,068 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,071 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,073 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,076 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,078 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,080 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,083 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,085 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,088 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,090 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,092 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,094 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,097 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,099 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,101 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,104 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,106 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:01,108 creating build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,109 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,111 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,114 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,116 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,118 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,121 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,123 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,125 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,128 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,130 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,132 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,134 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,137 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,139 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,141 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,143 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,145 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,148 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,150 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,152 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,155 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,157 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,159 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,162 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,164 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,166 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,169 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,171 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,173 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,176 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,179 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,181 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,184 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,186 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,188 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,191 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,193 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,196 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,198 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,200 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,203 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,205 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,208 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,210 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,213 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,215 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,217 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,220 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,222 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,225 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,227 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,230 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,232 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,235 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,237 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,239 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,242 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,244 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,246 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,248 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,251 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,253 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:01,256 copying lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:16:01,258 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:01,259 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:01,262 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:01,264 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:01,266 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:01,267 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:01,270 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:01,272 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:01,274 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:01,275 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:01,278 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:01,280 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:01,283 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:01,284 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:01,286 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:01,289 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:01,291 creating build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:01,292 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:01,295 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:01,297 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:01,300 copying lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:16:01,302 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,305 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,307 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,309 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,312 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,314 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,317 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,319 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,322 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,324 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,326 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,329 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,331 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,334 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,336 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,339 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,341 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,344 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,346 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,349 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:01,351 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,354 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,356 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,359 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,361 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,363 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,366 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,368 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,371 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,373 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,376 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,378 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,380 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,383 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,385 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,388 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,390 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,392 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,395 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,397 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:01,400 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,402 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,405 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,407 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,409 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,412 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,414 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,417 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,419 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,422 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,424 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,427 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,429 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,431 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,434 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,436 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,439 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,441 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,443 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,446 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:01,448 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,451 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,453 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,455 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,458 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,460 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,463 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,465 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,468 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,470 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,472 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,475 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,477 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,480 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,482 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,485 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,487 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,490 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,492 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,494 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:01,497 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,500 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,502 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,505 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,507 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,510 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,512 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,514 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,517 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,519 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,522 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,524 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,527 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,529 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,532 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,534 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,537 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,539 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,542 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,544 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:01,547 copying lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:16:01,549 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:01,550 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:01,553 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:01,556 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:01,558 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:01,559 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:01,562 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:01,564 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:01,566 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:01,567 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:01,570 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:01,572 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:01,574 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:01,576 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:01,578 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:01,581 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:01,583 creating build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:01,584 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:01,586 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:01,589 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:01,591 copying lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:16:01,594 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,596 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,598 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,601 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,603 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,606 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,608 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,611 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,614 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,617 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,619 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,621 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:01,624 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,626 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,628 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,631 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,633 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,635 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,637 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,640 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,642 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,645 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,648 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,650 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:01,653 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,656 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,659 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,663 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,665 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,668 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,670 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,672 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,675 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,677 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,680 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,682 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:01,685 copying lm_eval/tasks/afrobench/sib/sib.yaml -> build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:16:01,688 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,690 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,693 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,696 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,698 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,701 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,704 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,706 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,709 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,711 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,714 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,717 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,719 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,722 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,724 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,726 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,729 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,731 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,733 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,736 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,739 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,741 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,744 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,746 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,748 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,751 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,753 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,756 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,758 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,761 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,763 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,766 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,768 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,771 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,773 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,775 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,778 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,780 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,782 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,784 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,787 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,789 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,792 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,794 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,796 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,798 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,801 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,803 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,806 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,808 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,811 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,813 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,816 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,818 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,820 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,823 copying lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:01,826 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,828 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,831 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,833 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,836 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,838 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,841 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,843 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,846 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,848 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,851 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,853 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,856 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,858 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,861 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,863 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,866 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,868 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,870 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,873 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,875 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,878 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,880 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,883 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,885 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,887 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,890 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,892 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,895 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,897 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,900 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,902 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,905 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,907 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,910 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,912 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,914 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,917 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,919 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,922 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,924 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,927 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,929 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,931 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,933 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,936 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,938 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,940 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,942 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,945 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,947 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,949 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,951 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,954 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,956 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,958 copying lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:01,961 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,963 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,965 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,968 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,970 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,972 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,975 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,977 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,979 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,982 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,984 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,986 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,989 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,992 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,994 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,996 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:01,999 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,001 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,003 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,005 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,008 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,010 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,012 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,014 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,017 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,019 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,021 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,023 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,026 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,028 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,030 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,032 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,034 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,037 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,039 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,041 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,043 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,046 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,048 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,051 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,053 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,055 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,058 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,060 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,062 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,064 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,067 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,069 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,071 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,073 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,075 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,077 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,080 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,082 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,084 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,087 copying lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:02,089 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,091 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,094 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,096 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,099 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,101 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,103 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,106 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,108 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,110 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,113 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,115 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,117 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,120 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,122 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,124 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,127 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,129 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,132 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,134 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,136 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,138 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,140 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,143 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,145 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,147 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,149 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,151 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,154 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,156 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,158 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,161 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,163 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,165 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,168 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,170 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,172 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,174 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,177 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,179 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,181 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,184 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,186 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,189 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,191 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,193 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,196 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,198 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,201 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,203 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,206 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,208 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,210 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,212 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,215 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,217 copying lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:02,219 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,222 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,224 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,226 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,228 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,230 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,233 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,235 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,237 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,240 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,242 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,244 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,247 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,249 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,251 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,254 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,256 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,258 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,260 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,263 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,265 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,267 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,269 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,272 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,274 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,276 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,278 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,281 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,283 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,285 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,287 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,289 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,291 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,294 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,296 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,298 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,301 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,303 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,305 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,307 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,310 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,312 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,314 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,317 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,319 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,321 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,323 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,326 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,328 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,330 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,332 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,335 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,337 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,339 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,342 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,344 copying lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:02,346 copying lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,349 copying lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,351 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,353 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,355 copying lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,357 copying lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,360 copying lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,362 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,365 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,367 copying lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,369 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,371 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,373 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,376 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,378 copying lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,380 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,383 copying lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,385 copying lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,387 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,389 copying lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,391 copying lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,394 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,396 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,398 copying lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,400 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,403 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,405 copying lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,407 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,409 copying lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,411 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,413 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,416 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,418 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,420 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,422 copying lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,424 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,426 copying lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,428 copying lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,431 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,433 copying lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,435 copying lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,437 copying lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,439 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,442 copying lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,444 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,446 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,448 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,451 copying lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,453 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,455 copying lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,457 copying lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,459 copying lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,462 copying lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,464 copying lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,466 copying lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,468 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,470 copying lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,472 copying lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:02,475 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,477 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,479 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,482 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,484 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,486 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,488 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,491 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,493 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,495 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,498 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,500 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,502 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,504 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,507 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,509 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,511 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,514 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,516 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,519 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,521 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,523 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,525 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,527 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,530 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,532 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,534 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,536 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,538 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,540 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,542 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,545 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,547 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,549 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,551 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,553 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,555 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,557 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,560 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,562 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,564 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,566 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,568 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,571 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,573 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,575 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,577 copying lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,579 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,581 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,583 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,585 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,587 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,590 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,592 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,594 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,596 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,598 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,601 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:02,603 copying lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,605 copying lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,607 copying lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,609 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,612 copying lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,614 copying lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,616 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,618 copying lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,621 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,623 copying lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,625 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,628 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,630 copying lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,632 copying lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,634 copying lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,636 copying lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,638 copying lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,640 copying lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,642 copying lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,644 copying lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,646 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,649 copying lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,651 copying lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,653 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,655 copying lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,657 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,659 copying lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,661 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,664 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,666 copying lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,668 copying lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,670 copying lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,672 copying lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,675 copying lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,677 copying lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,679 copying lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,681 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,683 copying lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,686 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,688 copying lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,690 copying lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,692 copying lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,695 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,697 copying lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,699 copying lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,701 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,703 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,706 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,708 copying lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,710 copying lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,712 copying lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,714 copying lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,717 copying lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,719 copying lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,721 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,723 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,726 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,728 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:02,730 copying lm_eval/tasks/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:16:02,733 copying lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:02,735 copying lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml -> build/lib/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:02,737 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:02,739 copying lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:02,742 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:02,744 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:02,746 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:02,748 copying lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:02,750 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:02,752 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:02,755 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:02,757 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:02,759 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:02,761 copying lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:02,763 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,766 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,768 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,770 copying lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,772 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,774 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,777 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,779 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,781 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,783 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,786 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,788 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,790 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,792 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,794 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,797 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,799 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,801 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,803 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,805 copying lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,808 copying lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,810 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,812 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,815 copying lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,817 copying lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:02,819 copying lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:02,821 copying lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:02,823 copying lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:02,826 copying lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:02,828 copying lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:02,830 copying lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,832 copying lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,835 copying lm_eval/tasks/unitxt/xsum.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,837 copying lm_eval/tasks/unitxt/atis.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,839 copying lm_eval/tasks/unitxt/argument_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,841 copying lm_eval/tasks/unitxt/stsb.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,844 copying lm_eval/tasks/unitxt/unfair_tos.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,847 copying lm_eval/tasks/unitxt/ledgar.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,849 copying lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,852 copying lm_eval/tasks/unitxt/ag_news.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,854 copying lm_eval/tasks/unitxt/doc_vqa.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,857 copying lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,859 copying lm_eval/tasks/unitxt/financial_tweets.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,861 copying lm_eval/tasks/unitxt/coedit_gec.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,863 copying lm_eval/tasks/unitxt/banking77.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,866 copying lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,868 copying lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,871 copying lm_eval/tasks/unitxt/ethos_binary.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,873 copying lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:02,875 creating build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,876 copying lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,878 copying lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,881 copying lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,883 copying lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,885 copying lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,887 copying lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,889 copying lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,891 copying lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,894 copying lm_eval/tasks/turkishmmlu/config/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:02,896 creating build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,897 copying lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,902 copying lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,904 copying lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,907 copying lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,910 copying lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,912 copying lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,915 copying lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,918 copying lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,921 copying lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:02,924 copying lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:16:02,927 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,929 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,931 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,934 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,936 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,938 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,941 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,944 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,947 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,949 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,951 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,954 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,956 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,958 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,961 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,963 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,965 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,967 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,970 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,972 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,974 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,977 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,979 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,982 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,984 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,986 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,988 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,991 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,993 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,995 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:02,998 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,000 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,002 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,005 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,007 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,009 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,011 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,014 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,016 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,019 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,021 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,024 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,026 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,028 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,031 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,033 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,035 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,037 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,039 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,041 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,044 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,046 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,048 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,051 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,053 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,055 copying lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,057 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,060 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,062 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,064 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,067 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,069 copying lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:03,072 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,074 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,077 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,080 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,082 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,085 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,087 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,090 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,093 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,095 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,098 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,100 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,102 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,106 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,108 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,111 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,114 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,117 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,120 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,122 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,125 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,129 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,131 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,134 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,137 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,139 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,142 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,144 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,147 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,150 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,152 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,155 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,158 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,161 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,164 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,167 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,169 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,172 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,175 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,177 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,180 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,183 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,186 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,189 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,192 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,195 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,198 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,201 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,204 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,207 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,209 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,212 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,215 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,218 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,220 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,223 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,226 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,228 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,231 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,233 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,236 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,238 copying lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:03,241 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,244 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,246 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,249 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,251 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,253 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,256 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,258 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,260 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,263 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,265 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,268 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,270 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,273 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,276 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,278 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,281 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,284 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,286 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,289 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,291 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,293 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,296 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,298 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,300 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,303 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,306 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,308 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,311 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,313 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,316 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,318 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,320 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,323 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,326 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,328 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,331 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,333 copying lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,336 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,338 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,341 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,343 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,346 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,348 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,351 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,354 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,357 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,359 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,362 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,364 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,367 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,369 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,372 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,374 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,376 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,379 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,382 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,384 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,387 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,389 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,392 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,395 copying lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:03,397 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,401 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,404 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,407 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,410 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,413 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,416 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,419 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,422 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,425 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,427 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,430 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,433 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,436 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,439 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,441 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,444 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,447 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,450 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,453 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,456 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,459 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,461 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,464 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,467 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,471 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,474 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,478 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,481 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,484 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,487 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,491 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,494 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,497 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,500 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,503 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,506 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,509 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,512 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,516 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,519 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,522 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,526 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,528 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,532 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,534 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,538 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,540 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,543 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,547 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,550 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,553 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,557 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,560 copying lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,563 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,566 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,570 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,573 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,576 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,580 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,583 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,587 copying lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:03,590 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,592 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,595 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,598 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,600 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,603 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,606 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,609 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,611 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,614 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,617 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,620 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,623 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,626 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,629 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,631 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,634 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,637 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,640 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,643 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,645 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,648 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,651 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,654 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,657 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,659 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,662 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,665 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,669 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,672 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,676 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,679 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,683 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,686 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,690 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,693 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,696 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,699 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,703 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,706 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,710 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,713 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,717 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,720 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,723 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,726 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,729 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,733 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,736 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,740 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,743 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,746 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,750 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,753 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,756 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,760 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,763 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,766 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,769 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,772 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,774 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,777 copying lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:03,779 creating build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:16:03,780 copying lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:16:03,783 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,785 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,788 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,790 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,793 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,795 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,798 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,800 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,803 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,806 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,808 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,810 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,813 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,815 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,818 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,821 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,823 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,826 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,828 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,830 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,833 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,835 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,838 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,840 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,842 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,845 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,847 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,850 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,852 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,855 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,857 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,860 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,862 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,865 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,867 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,870 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,872 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,875 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,877 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,880 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,882 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,885 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,887 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,890 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,892 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,895 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,897 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,900 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,902 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,905 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,907 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,910 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,912 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,915 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,917 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,919 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,922 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,924 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,927 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,930 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,932 copying lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,935 copying lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:03,937 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,939 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,941 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,944 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,946 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,948 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,951 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,953 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,956 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,958 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,961 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,963 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,965 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,968 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,970 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,972 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,975 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,977 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,979 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,982 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,984 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,986 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,989 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,991 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,994 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,996 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:03,998 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,001 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,003 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,006 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,009 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,011 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,014 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,016 copying lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,019 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,021 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,024 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,026 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,028 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,031 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,033 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,035 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,038 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,040 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,042 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,044 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,047 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,049 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,051 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,054 copying lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,057 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,059 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,061 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,064 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,066 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,068 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,071 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,073 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,075 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,078 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,080 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,082 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,085 copying lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:04,087 creating build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,089 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,091 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,094 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,097 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,099 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,102 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,104 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,107 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,109 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,112 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,114 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,116 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,119 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,121 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,123 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,126 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,128 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,131 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,133 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,136 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,138 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,141 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,143 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,146 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,148 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,151 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,153 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,156 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,158 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,161 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,163 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,165 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,168 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,170 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,172 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,175 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,177 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,180 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,182 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,184 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,187 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,189 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,192 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,194 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,197 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,199 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,202 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,204 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,207 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,209 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,212 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,214 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,216 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,219 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,221 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,224 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,226 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,228 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,231 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,233 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,235 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,238 copying lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:04,240 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,243 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,245 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,247 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,250 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,252 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,254 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,256 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,259 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,261 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,264 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,266 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,268 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,271 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,273 copying lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:04,276 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,278 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,280 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,283 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,285 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,288 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,290 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,293 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,295 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,297 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,300 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,302 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,305 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,307 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,310 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,312 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,315 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,317 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,320 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,322 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,325 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,327 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,330 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,332 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,334 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,337 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,339 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,342 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,345 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,347 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,350 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,353 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,355 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,358 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,360 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,363 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,365 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,367 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,369 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,372 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,374 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,376 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,379 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,381 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,384 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,387 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,389 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,392 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,394 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,397 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,399 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,402 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,404 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,407 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,409 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,412 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,414 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,417 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,419 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,422 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,424 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,427 copying lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:04,430 copying lm_eval/tasks/mutual/multual_plus.yaml -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:16:04,432 copying lm_eval/tasks/mutual/mutual.yaml -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:16:04,434 copying lm_eval/tasks/aradice/aradice.yaml -> build/lib/lm_eval/tasks/aradice 2026-09-01T00:16:04,437 copying lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/lib/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:16:04,440 copying lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/lib/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:16:04,443 copying lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/lib/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:16:04,445 copying lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/lib/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:16:04,448 copying lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:04,450 copying lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:04,452 copying lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:04,455 copying lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:04,457 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:04,460 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:04,462 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:04,465 copying lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/lib/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:04,467 copying lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:16:04,469 copying lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:16:04,472 copying lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:16:04,474 copying lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/lib/lm_eval/tasks/aradice/piqa 2026-09-01T00:16:04,477 copying lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:04,479 copying lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:04,482 copying lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:04,484 copying lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:04,486 copying lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:04,489 copying lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/lib/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:04,492 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,494 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,497 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,499 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,501 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,504 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,506 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,508 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,511 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,513 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,516 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,518 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,521 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,523 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,525 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,528 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,530 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,533 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,535 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,538 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,540 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,542 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,545 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,547 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,550 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,552 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,554 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,557 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,559 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,561 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,563 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,566 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,568 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,571 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,573 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,575 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,578 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,580 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,582 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,585 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,587 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:04,590 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,592 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,594 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,597 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,599 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,601 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,604 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,606 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,608 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,611 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,613 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,615 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,617 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,620 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,622 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,624 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,627 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,629 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,631 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,633 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,636 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,638 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,640 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,643 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,645 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,648 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,650 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,652 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,655 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,657 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,659 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,661 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,664 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,666 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,668 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,670 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,673 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,675 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,677 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,680 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,682 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:04,685 copying lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:04,687 copying lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:04,689 copying lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:04,691 copying lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/lib/lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:04,694 creating build/lib/lm_eval/tasks/eus_proficiency 2026-09-01T00:16:04,695 copying lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/lib/lm_eval/tasks/eus_proficiency 2026-09-01T00:16:04,698 copying lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:04,700 copying lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:04,702 copying lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:04,704 copying lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:04,707 copying lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:04,709 copying lm_eval/tasks/bbq/bbq_generate.yaml -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:04,712 copying lm_eval/tasks/tydiqa/tydiqa_goldp_bn.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,714 copying lm_eval/tasks/tydiqa/tydiqa_goldp_ru.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,717 copying lm_eval/tasks/tydiqa/tydiqa_goldp_fi.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,719 copying lm_eval/tasks/tydiqa/tydiqa_goldp_en.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,721 copying lm_eval/tasks/tydiqa/tydiqa_goldp_sw.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,724 copying lm_eval/tasks/tydiqa/tydiqa_goldp_ar.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,726 copying lm_eval/tasks/tydiqa/tydiqa_goldp_te.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,729 copying lm_eval/tasks/tydiqa/tydiqa_goldp_id.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,731 copying lm_eval/tasks/tydiqa/tydiqa_goldp_ko.yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:04,733 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,735 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,738 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,740 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,742 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,745 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,747 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,749 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,752 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,754 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,756 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,758 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,760 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,763 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,765 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,767 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,770 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,772 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,774 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,776 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,779 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,781 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,783 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,785 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,787 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,790 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,792 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,794 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,796 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,799 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,801 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,803 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,805 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,807 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,810 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,812 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,814 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,817 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,819 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,821 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,823 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,826 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,828 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,831 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,833 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,835 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,837 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,840 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,842 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,844 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,847 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,849 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,851 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,853 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,856 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,858 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,860 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,863 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,865 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:04,868 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,870 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,872 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,875 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,877 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,879 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,882 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,884 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,887 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,889 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,891 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,894 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,896 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,898 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,901 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,903 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,905 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,908 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,910 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,912 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,915 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,917 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,919 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,921 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,924 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,926 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,928 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,930 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,933 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,935 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,937 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,940 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,942 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,944 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,946 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,949 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,951 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,953 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,956 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,958 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,960 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,963 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,965 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,967 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,970 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,972 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,974 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,977 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,979 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,981 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,984 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,986 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,988 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,990 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,993 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,995 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,997 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:04,999 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:05,002 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,004 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,007 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,009 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,011 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,014 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,016 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,018 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,021 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,023 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,025 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,028 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,030 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,032 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,034 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,037 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,039 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,041 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,043 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,046 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,048 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,050 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,052 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,055 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,057 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,059 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,061 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,064 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,066 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,068 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,070 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,073 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,075 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,077 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,079 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,081 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,084 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,086 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,088 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,090 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,093 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,095 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,098 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,100 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,102 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,104 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,106 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,109 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,111 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,113 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,115 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,117 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,120 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,122 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,124 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,127 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,129 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,131 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:05,134 creating build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,135 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,137 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,140 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,143 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,145 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,148 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,150 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,153 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,155 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,158 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,160 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,162 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,165 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,167 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,170 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,173 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,175 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,178 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,180 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,183 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,185 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,188 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,190 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,193 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,195 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,197 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,200 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,202 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,205 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,208 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,210 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,213 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,216 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,218 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,221 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,223 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,226 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,229 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,232 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,234 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,237 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,239 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,242 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,244 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,247 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,250 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,253 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,256 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,258 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,261 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,263 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,266 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,268 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,271 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,273 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,276 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,278 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,281 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:05,283 creating build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,285 copying lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,287 copying lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,290 copying lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,292 copying lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,295 copying lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,297 copying lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,300 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,302 copying lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,305 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,307 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,309 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,311 copying lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,313 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,316 copying lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,318 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,320 copying lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,322 copying lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,324 copying lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,327 copying lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,329 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,331 copying lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,334 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,336 copying lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,338 copying lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,341 copying lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,343 copying lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,345 copying lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,348 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,350 copying lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,352 copying lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,354 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,357 copying lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,359 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,362 copying lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,364 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,367 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,369 copying lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,371 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,374 copying lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,376 copying lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,378 copying lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,380 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,382 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,384 copying lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,387 copying lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,389 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,391 copying lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,394 copying lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,396 copying lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,398 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,400 copying lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,403 copying lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,405 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,407 copying lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,410 copying lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,412 copying lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,414 copying lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,417 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:05,419 creating build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,420 copying lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,422 copying lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,425 copying lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,427 copying lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,429 copying lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,431 copying lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,434 copying lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,436 copying lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,438 copying lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,441 copying lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,443 copying lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,445 copying lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,447 copying lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,450 copying lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,452 copying lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,454 copying lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,456 copying lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,458 copying lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,461 copying lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,463 copying lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,465 copying lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,468 copying lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,470 copying lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,472 copying lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,474 copying lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,477 copying lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,479 copying lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,481 copying lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,484 copying lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,486 copying lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,488 copying lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,491 copying lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,493 copying lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,495 copying lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,498 copying lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,500 copying lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,502 copying lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,504 copying lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,507 copying lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,509 copying lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,511 copying lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,513 copying lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,516 copying lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,518 copying lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,520 copying lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,522 copying lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,525 copying lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,527 copying lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,529 copying lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,531 copying lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,533 copying lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,535 copying lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,538 copying lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,540 copying lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,542 copying lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,544 copying lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,547 copying lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,549 copying lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,551 copying lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,553 copying lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,555 copying lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,557 copying lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:05,559 creating build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,560 copying lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,563 copying lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,565 copying lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,568 copying lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,570 copying lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,572 copying lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,574 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,576 copying lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,578 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,580 copying lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,583 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,585 copying lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,587 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,589 copying lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,591 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,593 copying lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,595 copying lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,597 copying lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,599 copying lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,602 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,604 copying lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,606 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,608 copying lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,610 copying lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,613 copying lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,615 copying lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,617 copying lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,619 copying lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,622 copying lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,624 copying lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,626 copying lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,628 copying lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,630 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,633 copying lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,635 copying lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,638 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,640 copying lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,642 copying lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,645 copying lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,647 copying lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,649 copying lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,652 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,654 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,656 copying lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,658 copying lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,660 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,663 copying lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,665 copying lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,667 copying lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,669 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,672 copying lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,674 copying lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,676 copying lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,679 copying lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,681 copying lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,683 copying lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,686 copying lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,688 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:05,690 copying lm_eval/tasks/wikitext/wikitext.yaml -> build/lib/lm_eval/tasks/wikitext 2026-09-01T00:16:05,693 creating build/lib/lm_eval/tasks/pile_10k 2026-09-01T00:16:05,695 copying lm_eval/tasks/pile_10k/pile_10k.yaml -> build/lib/lm_eval/tasks/pile_10k 2026-09-01T00:16:05,697 copying lm_eval/tasks/medqa/medqa.yaml -> build/lib/lm_eval/tasks/medqa 2026-09-01T00:16:05,700 copying lm_eval/tasks/medtext/medtext.yaml -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:16:05,702 copying lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:16:05,705 copying lm_eval/tasks/noticia/noticia.yaml -> build/lib/lm_eval/tasks/noticia 2026-09-01T00:16:05,707 copying lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:16:05,709 copying lm_eval/tasks/olaph/olaph.yaml -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:16:05,712 copying lm_eval/tasks/race/race.yaml -> build/lib/lm_eval/tasks/race 2026-09-01T00:16:05,715 copying lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,717 copying lm_eval/tasks/metabench/metabench_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,719 copying lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,722 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,724 copying lm_eval/tasks/metabench/metabench.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,726 copying lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,729 copying lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,731 copying lm_eval/tasks/metabench/metabench_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,733 copying lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,736 copying lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,738 copying lm_eval/tasks/metabench/metabench_arc.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,740 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,742 copying lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,744 copying lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,747 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,749 copying lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,751 copying lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,753 copying lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,755 copying lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,758 copying lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,760 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,762 copying lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,764 copying lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,766 copying lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,769 copying lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,771 copying lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:05,773 copying lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,775 copying lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,777 copying lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,780 copying lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,782 copying lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,784 copying lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,786 copying lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:05,788 creating build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:05,790 copying lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:05,792 copying lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:05,795 copying lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:05,797 copying lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:05,799 copying lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:05,801 creating build/lib/lm_eval/tasks/anli 2026-09-01T00:16:05,802 copying lm_eval/tasks/anli/anli_r1.yaml -> build/lib/lm_eval/tasks/anli 2026-09-01T00:16:05,805 copying lm_eval/tasks/anli/anli_r2.yaml -> build/lib/lm_eval/tasks/anli 2026-09-01T00:16:05,807 copying lm_eval/tasks/anli/anli_r3.yaml -> build/lib/lm_eval/tasks/anli 2026-09-01T00:16:05,809 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,811 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,814 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,816 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,818 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,820 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,822 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,825 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,827 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,829 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,831 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,834 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,836 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,838 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,841 copying lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,843 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,845 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,847 copying lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:05,850 copying lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,852 copying lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,854 copying lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,856 copying lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,859 copying lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,861 copying lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,863 copying lm_eval/tasks/paloma/paloma_mc4.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,866 copying lm_eval/tasks/paloma/paloma_ptb.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,868 copying lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,870 copying lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,872 copying lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,874 copying lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,876 copying lm_eval/tasks/paloma/paloma_gab.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,879 copying lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,881 copying lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,883 copying lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:05,886 copying lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:16:05,888 copying lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:16:05,890 copying lm_eval/tasks/graphwalks/graphwalks.yaml -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:16:05,892 creating build/lib/lm_eval/tasks/prost 2026-09-01T00:16:05,893 copying lm_eval/tasks/prost/corypaik_prost.yaml -> build/lib/lm_eval/tasks/prost 2026-09-01T00:16:05,896 copying lm_eval/tasks/moral_stories/moral_stories.yaml -> build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:16:05,898 creating build/lib/lm_eval/tasks/sciq 2026-09-01T00:16:05,899 copying lm_eval/tasks/sciq/sciq.yaml -> build/lib/lm_eval/tasks/sciq 2026-09-01T00:16:05,901 creating build/lib/lm_eval/tasks/swag 2026-09-01T00:16:05,902 copying lm_eval/tasks/swag/swag.yaml -> build/lib/lm_eval/tasks/swag 2026-09-01T00:16:05,905 copying lm_eval/tasks/putnam_axiom/putnam_axiom_variations_org.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:16:05,908 copying lm_eval/tasks/putnam_axiom/putnam_axiom_original.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:16:05,910 copying lm_eval/tasks/putnam_axiom/putnam_axiom_variations.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:16:05,912 copying lm_eval/tasks/putnam_axiom/putnam_axiom.yaml -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:16:05,914 creating build/lib/lm_eval/tasks/arc 2026-09-01T00:16:05,915 copying lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/lib/lm_eval/tasks/arc 2026-09-01T00:16:05,918 copying lm_eval/tasks/arc/arc_easy.yaml -> build/lib/lm_eval/tasks/arc 2026-09-01T00:16:05,920 copying lm_eval/tasks/arc/arc_challenge.yaml -> build/lib/lm_eval/tasks/arc 2026-09-01T00:16:05,923 copying lm_eval/tasks/common_voice/common_voice_en.yaml -> build/lib/lm_eval/tasks/common_voice 2026-09-01T00:16:05,925 creating build/lib/lm_eval/tasks/glue/qqp 2026-09-01T00:16:05,927 copying lm_eval/tasks/glue/qqp/default.yaml -> build/lib/lm_eval/tasks/glue/qqp 2026-09-01T00:16:05,929 copying lm_eval/tasks/glue/mnli/mismatch.yaml -> build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:16:05,932 copying lm_eval/tasks/glue/mnli/default.yaml -> build/lib/lm_eval/tasks/glue/mnli 2026-09-01T00:16:05,934 creating build/lib/lm_eval/tasks/glue/wnli 2026-09-01T00:16:05,935 copying lm_eval/tasks/glue/wnli/default.yaml -> build/lib/lm_eval/tasks/glue/wnli 2026-09-01T00:16:05,937 creating build/lib/lm_eval/tasks/glue/rte 2026-09-01T00:16:05,939 copying lm_eval/tasks/glue/rte/default.yaml -> build/lib/lm_eval/tasks/glue/rte 2026-09-01T00:16:05,941 creating build/lib/lm_eval/tasks/glue/qnli 2026-09-01T00:16:05,942 copying lm_eval/tasks/glue/qnli/default.yaml -> build/lib/lm_eval/tasks/glue/qnli 2026-09-01T00:16:05,944 creating build/lib/lm_eval/tasks/glue/sst2 2026-09-01T00:16:05,946 copying lm_eval/tasks/glue/sst2/default.yaml -> build/lib/lm_eval/tasks/glue/sst2 2026-09-01T00:16:05,948 creating build/lib/lm_eval/tasks/glue/mrpc 2026-09-01T00:16:05,949 copying lm_eval/tasks/glue/mrpc/default.yaml -> build/lib/lm_eval/tasks/glue/mrpc 2026-09-01T00:16:05,951 creating build/lib/lm_eval/tasks/glue/cola 2026-09-01T00:16:05,952 copying lm_eval/tasks/glue/cola/default.yaml -> build/lib/lm_eval/tasks/glue/cola 2026-09-01T00:16:05,955 copying lm_eval/tasks/qasper/freeform.yaml -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:16:05,957 copying lm_eval/tasks/qasper/bool.yaml -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:16:05,959 copying lm_eval/tasks/hellaswag/hellaswag.yaml -> build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:16:05,961 copying lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,964 copying lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,966 copying lm_eval/tasks/esbbq/esbbq_age.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,968 copying lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,970 copying lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,972 copying lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,974 copying lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,977 copying lm_eval/tasks/esbbq/esbbq.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,979 copying lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,981 copying lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,983 copying lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:05,986 copying lm_eval/tasks/jfinqa/jfinqa_temporal.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:16:05,988 copying lm_eval/tasks/jfinqa/jfinqa_numerical.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:16:05,990 copying lm_eval/tasks/jfinqa/jfinqa_consistency.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:16:05,992 copying lm_eval/tasks/jfinqa/_jfinqa.yaml -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:16:05,994 creating build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:05,996 copying lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:05,998 copying lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,000 copying lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,003 copying lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,005 copying lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,007 copying lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,009 copying lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,012 copying lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,014 copying lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,017 copying lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,020 copying lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,022 copying lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,024 copying lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,026 copying lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,029 copying lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,031 copying lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,034 copying lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,036 copying lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,038 copying lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,041 copying lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,043 copying lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,045 copying lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,048 copying lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,050 copying lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,052 copying lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,055 copying lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,057 copying lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,060 copying lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,062 copying lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,064 copying lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,066 copying lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,068 copying lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,071 copying lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,073 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,076 copying lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,078 copying lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,080 copying lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,082 copying lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,085 copying lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,087 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,089 copying lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,091 copying lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,093 copying lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,095 copying lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,098 copying lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,100 copying lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,102 copying lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,104 copying lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,106 copying lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,108 copying lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,110 copying lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,113 copying lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,115 copying lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,117 copying lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,119 copying lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,121 copying lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,123 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,126 copying lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,128 copying lm_eval/tasks/bigbench/generate_until/color.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,130 copying lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,132 copying lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,134 copying lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,137 copying lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,139 copying lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,141 copying lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,143 copying lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,146 copying lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,148 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,150 copying lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,152 copying lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,154 copying lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,156 copying lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,158 copying lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,161 copying lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,163 copying lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,165 copying lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,167 copying lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,169 copying lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,172 copying lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,174 copying lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,176 copying lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,178 copying lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,180 copying lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,183 copying lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,186 copying lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,188 copying lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,190 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,192 copying lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,195 copying lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,197 copying lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,199 copying lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,201 copying lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,203 copying lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,206 copying lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,208 copying lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,210 copying lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,212 copying lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,214 copying lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,217 copying lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,219 copying lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,221 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,223 copying lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,225 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,228 copying lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,230 copying lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,232 copying lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,234 copying lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,237 copying lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,239 copying lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,241 copying lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,244 copying lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,246 copying lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,248 copying lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,251 copying lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,253 copying lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,256 copying lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,258 copying lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,260 copying lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,263 copying lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,265 copying lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,268 copying lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,270 copying lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,273 copying lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,275 copying lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,277 copying lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,279 copying lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,282 copying lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,284 copying lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,286 copying lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,288 copying lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,291 copying lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,293 copying lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,296 copying lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,298 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,300 copying lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,302 copying lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,304 copying lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,307 copying lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,309 copying lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,311 copying lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,313 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,315 copying lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,318 copying lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,320 copying lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,323 copying lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,325 copying lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,327 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,330 copying lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,332 copying lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,334 copying lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,337 copying lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,339 copying lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,341 copying lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,343 copying lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,346 copying lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,348 copying lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,350 copying lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,352 copying lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,355 copying lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,357 copying lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,359 copying lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,362 copying lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,364 copying lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,366 copying lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,369 copying lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,371 copying lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,373 copying lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:06,376 creating build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,377 copying lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,379 copying lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,382 copying lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,384 copying lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,386 copying lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,389 copying lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,391 copying lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,394 copying lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,396 copying lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,399 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,401 copying lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,403 copying lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,406 copying lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,408 copying lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,410 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,412 copying lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,415 copying lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,417 copying lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,419 copying lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,422 copying lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,425 copying lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,427 copying lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,429 copying lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,431 copying lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,433 copying lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,436 copying lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,438 copying lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,440 copying lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,443 copying lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,445 copying lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,447 copying lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,449 copying lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,452 copying lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,454 copying lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,456 copying lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,459 copying lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,461 copying lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,464 copying lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,466 copying lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,469 copying lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,471 copying lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,473 copying lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,475 copying lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,477 copying lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,480 copying lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,482 copying lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,484 copying lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,487 copying lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,489 copying lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,491 copying lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,493 copying lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,496 copying lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,498 copying lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,501 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,503 copying lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,506 copying lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,509 copying lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,511 copying lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,514 copying lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,516 copying lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,518 copying lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,521 copying lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,523 copying lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,526 copying lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,528 copying lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,530 copying lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,532 copying lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,534 copying lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,537 copying lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,539 copying lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,541 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,543 copying lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,545 copying lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,547 copying lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,550 copying lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,552 copying lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,554 copying lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,557 copying lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,560 copying lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,562 copying lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,564 copying lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,567 copying lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,569 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,571 copying lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,573 copying lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,576 copying lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,578 copying lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,580 copying lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,582 copying lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,585 copying lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,587 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,589 copying lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,592 copying lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,594 copying lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,596 copying lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,599 copying lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,601 copying lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,603 copying lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,606 copying lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,608 copying lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,610 copying lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,612 copying lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,615 copying lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,617 copying lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,620 copying lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,622 copying lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,624 copying lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,626 copying lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,629 copying lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,631 copying lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,633 copying lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,635 copying lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,638 copying lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,640 copying lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,642 copying lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,645 copying lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,647 copying lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,649 copying lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,651 copying lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:06,654 copying lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,656 copying lm_eval/tasks/e2lmc/noor/_noor_stem.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,658 copying lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,660 copying lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,662 copying lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,665 copying lm_eval/tasks/e2lmc/noor/_noor.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,667 copying lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,669 copying lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,671 copying lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,673 copying lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,676 copying lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,678 copying lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,680 copying lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,682 copying lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:06,685 copying lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:16:06,687 creating build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:06,688 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:06,691 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:06,693 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:06,695 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:06,697 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:06,699 creating build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:16:06,700 copying lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:16:06,703 copying lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:16:06,705 copying lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:16:06,708 copying lm_eval/tasks/leaderboard/leaderboard.yaml -> build/lib/lm_eval/tasks/leaderboard 2026-09-01T00:16:06,710 copying lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:06,713 copying lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:06,715 copying lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:06,717 copying lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:06,720 copying lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,722 copying lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,724 copying lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,727 copying lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,729 copying lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,731 copying lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,733 copying lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,735 copying lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:06,737 copying lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:06,739 copying lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:06,741 copying lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:06,743 copying lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:06,745 copying lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:06,747 copying lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:06,750 copying lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:16:06,752 creating build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,753 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,755 copying lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,758 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,760 copying lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,762 copying lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,765 copying lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,767 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,769 copying lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,772 copying lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,774 copying lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,776 copying lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,779 copying lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,781 copying lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,783 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,785 copying lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,788 copying lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,790 copying lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,793 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,795 copying lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,798 copying lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,800 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,802 copying lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,805 copying lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,807 copying lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,809 copying lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:06,812 copying lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,814 copying lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,816 copying lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,818 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,820 copying lm_eval/tasks/blimp/intransitive.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,823 copying lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,825 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,827 copying lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,829 copying lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,831 copying lm_eval/tasks/blimp/transitive.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,833 copying lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,835 copying lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,837 copying lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,840 copying lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,842 copying lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,844 copying lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,846 copying lm_eval/tasks/blimp/adjunct_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,848 copying lm_eval/tasks/blimp/inchoative.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,850 copying lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,852 copying lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,854 copying lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,857 copying lm_eval/tasks/blimp/_blimp.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,859 copying lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,861 copying lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,863 copying lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,866 copying lm_eval/tasks/blimp/wh_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,868 copying lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,870 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,872 copying lm_eval/tasks/blimp/causative.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,874 copying lm_eval/tasks/blimp/npi_present_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,877 copying lm_eval/tasks/blimp/npi_present_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,879 copying lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,881 copying lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,883 copying lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,885 copying lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,887 copying lm_eval/tasks/blimp/drop_argument.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,889 copying lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,891 copying lm_eval/tasks/blimp/passive_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,894 copying lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,896 copying lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,898 copying lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,900 copying lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,902 copying lm_eval/tasks/blimp/only_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,904 copying lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,906 copying lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,909 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,911 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,913 copying lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,915 copying lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,917 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,920 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,922 copying lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,924 copying lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,926 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,929 copying lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,931 copying lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,933 copying lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,935 copying lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,937 copying lm_eval/tasks/blimp/passive_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,940 copying lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,942 copying lm_eval/tasks/blimp/complex_NP_island.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,944 copying lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,946 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,948 copying lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,951 copying lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,953 copying lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,955 copying lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,957 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:06,960 copying lm_eval/tasks/nerel-bench/ru_relation_extraction.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:16:06,962 copying lm_eval/tasks/nerel-bench/ru_entity_recognition.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:16:06,964 copying lm_eval/tasks/nerel-bench/ru_relation_definition.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:16:06,966 copying lm_eval/tasks/nerel-bench/ru_entity_definition.yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:16:06,968 copying lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,970 copying lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,973 copying lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,975 copying lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,977 copying lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,979 copying lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,981 copying lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,983 copying lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:06,986 creating build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:06,987 copying lm_eval/tasks/unscramble/cycle_letters.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:06,989 copying lm_eval/tasks/unscramble/anagrams2.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:06,992 copying lm_eval/tasks/unscramble/reversed_words.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:06,994 copying lm_eval/tasks/unscramble/anagrams1.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:06,996 copying lm_eval/tasks/unscramble/random_insertion.yaml -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:06,999 copying lm_eval/tasks/squadv2/squadv2.yaml -> build/lib/lm_eval/tasks/squadv2 2026-09-01T00:16:07,003 copying lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,005 copying lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,007 copying lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,009 copying lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,011 copying lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,014 copying lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,016 copying lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,018 copying lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,020 copying lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,022 copying lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,025 copying lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,027 copying lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,029 copying lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,031 copying lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,033 copying lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:07,035 creating build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,036 copying lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,039 copying lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,041 copying lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,044 copying lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,046 copying lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,048 copying lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,050 copying lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,053 copying lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,055 copying lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,057 copying lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,060 copying lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,062 copying lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,064 copying lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,066 copying lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,068 copying lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,071 copying lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,073 copying lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,075 copying lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,077 copying lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,080 copying lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,082 copying lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,084 copying lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,087 copying lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,089 copying lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,092 copying lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,094 copying lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,096 copying lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,099 copying lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,101 copying lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,103 copying lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,105 copying lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,108 copying lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,110 copying lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,112 copying lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,114 copying lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,116 copying lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,118 copying lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,120 copying lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,122 copying lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,124 copying lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,126 copying lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,128 copying lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,131 copying lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,133 copying lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,135 copying lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,137 copying lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,139 copying lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,142 copying lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,144 copying lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,146 copying lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,149 copying lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,151 copying lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,153 copying lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,155 copying lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,157 copying lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,160 copying lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,162 copying lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,164 copying lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,166 copying lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,168 copying lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,171 copying lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,173 copying lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,175 copying lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,178 copying lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,181 copying lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,183 copying lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,185 copying lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,187 copying lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,190 copying lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,192 copying lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,195 copying lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,209 copying lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,211 copying lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,214 copying lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,216 copying lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,219 copying lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,222 copying lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,224 copying lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,227 copying lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,229 copying lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,232 copying lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,234 copying lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,236 copying lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,238 copying lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,241 copying lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,243 copying lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,245 copying lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,247 copying lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,250 copying lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,253 copying lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,255 copying lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,257 copying lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,259 copying lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,261 copying lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,264 copying lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,266 copying lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,268 copying lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,270 copying lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,272 copying lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,274 copying lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,277 copying lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:07,279 copying lm_eval/tasks/medmcqa/medmcqa.yaml -> build/lib/lm_eval/tasks/medmcqa 2026-09-01T00:16:07,281 creating build/lib/lm_eval/tasks/polemo2 2026-09-01T00:16:07,283 copying lm_eval/tasks/polemo2/polemo2_out.yaml -> build/lib/lm_eval/tasks/polemo2 2026-09-01T00:16:07,285 copying lm_eval/tasks/polemo2/polemo2_in.yaml -> build/lib/lm_eval/tasks/polemo2 2026-09-01T00:16:07,287 creating build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:07,289 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:07,292 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:07,294 copying lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:07,296 copying lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:07,298 creating build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,300 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,303 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,305 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,308 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,310 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,312 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,315 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,317 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,319 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,322 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,324 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,326 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,329 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:07,331 creating build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,332 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,335 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,337 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,339 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,342 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,344 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,346 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,348 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,350 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,353 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,355 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,357 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,359 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,361 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:07,363 creating build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,365 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,367 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,369 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,372 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,374 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,376 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,378 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,381 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,383 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,385 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,388 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,390 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,392 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,395 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:07,397 creating build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,398 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,400 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,403 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,405 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,407 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,409 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,412 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,414 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,416 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,418 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,420 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,422 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,425 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:07,427 creating build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,428 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,431 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,433 copying lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,435 copying lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,437 copying lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,439 copying lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,442 copying lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:07,444 copying lm_eval/tasks/libra/ru_gsm100.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,447 copying lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,449 copying lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,451 copying lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,453 copying lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,456 copying lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,458 copying lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,460 copying lm_eval/tasks/libra/ru_qasper.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,462 copying lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,464 copying lm_eval/tasks/libra/ru_quality.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,466 copying lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,468 copying lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,470 copying lm_eval/tasks/libra/librusec_history.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,473 copying lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,475 copying lm_eval/tasks/libra/matreshka_names.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,477 copying lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,479 copying lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,481 copying lm_eval/tasks/libra/long_context_multiq.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,484 copying lm_eval/tasks/libra/passkey.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,486 copying lm_eval/tasks/libra/librusec_mhqa.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,488 copying lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,490 copying lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:07,492 copying lm_eval/tasks/winogrande/default.yaml -> build/lib/lm_eval/tasks/winogrande 2026-09-01T00:16:07,494 creating build/lib/lm_eval/tasks/mc_taco 2026-09-01T00:16:07,496 copying lm_eval/tasks/mc_taco/default.yaml -> build/lib/lm_eval/tasks/mc_taco 2026-09-01T00:16:07,499 copying lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,502 copying lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,504 copying lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,506 copying lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,509 copying lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,511 copying lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,513 copying lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,516 copying lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,518 copying lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,520 copying lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:07,522 creating build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:07,523 copying lm_eval/tasks/bangla/bangla_openbookqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:07,525 copying lm_eval/tasks/bangla/bangla_mmlu.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:07,527 copying lm_eval/tasks/bangla/bangla_commonsenseqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:07,530 copying lm_eval/tasks/bangla/bangla_boolqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:07,532 copying lm_eval/tasks/bangla/bangla_piqa.yaml -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:07,536 copying lm_eval/tasks/README.md -> build/lib/lm_eval/tasks 2026-09-01T00:16:07,542 copying lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:07,545 copying lm_eval/tasks/hendrycks_ethics/README.md -> build/lib/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:07,548 copying lm_eval/tasks/acpbench/README.md -> build/lib/lm_eval/tasks/acpbench 2026-09-01T00:16:07,552 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:07,554 copying lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:07,557 copying lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:07,560 copying lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:07,562 copying lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/lib/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:07,564 copying lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:07,567 copying lm_eval/tasks/mbpp/README.md -> build/lib/lm_eval/tasks/mbpp 2026-09-01T00:16:07,570 copying lm_eval/tasks/truthfulqa/README.md -> build/lib/lm_eval/tasks/truthfulqa 2026-09-01T00:16:07,573 copying lm_eval/tasks/siqa/README.md -> build/lib/lm_eval/tasks/siqa 2026-09-01T00:16:07,575 copying lm_eval/tasks/c4/README.md -> build/lib/lm_eval/tasks/c4 2026-09-01T00:16:07,579 copying lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:07,581 copying lm_eval/tasks/mmlu-redux/generative/README.md -> build/lib/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:07,584 copying lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:16:07,600 copying lm_eval/tasks/blimp_nl/_template_yaml -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:16:07,603 copying lm_eval/tasks/blimp_nl/README.md -> build/lib/lm_eval/tasks/blimp_nl 2026-09-01T00:16:07,606 copying lm_eval/tasks/ulqa/README.md -> build/lib/lm_eval/tasks/ulqa 2026-09-01T00:16:07,609 copying lm_eval/tasks/lingoly/README.md -> build/lib/lm_eval/tasks/lingoly 2026-09-01T00:16:07,613 copying lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:07,616 copying lm_eval/tasks/mmlu-pro-plus/README.md -> build/lib/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:07,620 copying lm_eval/tasks/mimic_repsum/README.md -> build/lib/lm_eval/tasks/mimic_repsum 2026-09-01T00:16:07,623 copying lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:16:07,626 copying lm_eval/tasks/egymmlu/README.md -> build/lib/lm_eval/tasks/egymmlu 2026-09-01T00:16:07,630 copying lm_eval/tasks/aime/README.md -> build/lib/lm_eval/tasks/aime 2026-09-01T00:16:07,633 copying lm_eval/tasks/icelandic_winogrande/README.md -> build/lib/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:16:07,637 copying lm_eval/tasks/wmt2016/README.md -> build/lib/lm_eval/tasks/wmt2016 2026-09-01T00:16:07,639 copying lm_eval/tasks/xcopa/README.md -> build/lib/lm_eval/tasks/xcopa 2026-09-01T00:16:07,643 copying lm_eval/tasks/eus_exams/eus_exams -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:16:07,645 copying lm_eval/tasks/eus_exams/eus_exams_eu -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:16:07,647 copying lm_eval/tasks/eus_exams/eus_exams_es -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:16:07,650 copying lm_eval/tasks/eus_exams/README.md -> build/lib/lm_eval/tasks/eus_exams 2026-09-01T00:16:07,654 copying lm_eval/tasks/cruxeval/README.md -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:16:07,658 copying lm_eval/tasks/cruxeval/cruxeval_common_yaml -> build/lib/lm_eval/tasks/cruxeval 2026-09-01T00:16:07,660 copying lm_eval/tasks/translation/wmt_common_yaml -> build/lib/lm_eval/tasks/translation 2026-09-01T00:16:07,663 copying lm_eval/tasks/translation/README.md -> build/lib/lm_eval/tasks/translation 2026-09-01T00:16:07,666 copying lm_eval/tasks/galician_bench/README.md -> build/lib/lm_eval/tasks/galician_bench 2026-09-01T00:16:07,670 copying lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:07,672 copying lm_eval/tasks/greekmmlu/README.md -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:16:07,675 copying lm_eval/tasks/greekmmlu/_default_greekmmlu_template_yaml -> build/lib/lm_eval/tasks/greekmmlu 2026-09-01T00:16:07,678 copying lm_eval/tasks/openai-mmmlu/languages.json -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:07,680 copying lm_eval/tasks/openai-mmmlu/subjects.json -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:07,683 copying lm_eval/tasks/openai-mmmlu/README.md -> build/lib/lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:07,686 copying lm_eval/tasks/openai-mmmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:07,691 copying lm_eval/tasks/ruler/README.md -> build/lib/lm_eval/tasks/ruler 2026-09-01T00:16:07,697 copying lm_eval/tasks/openbookqa/README.md -> build/lib/lm_eval/tasks/openbookqa 2026-09-01T00:16:07,700 copying lm_eval/tasks/turblimp/_template_yaml -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:16:07,702 copying lm_eval/tasks/turblimp/README.md -> build/lib/lm_eval/tasks/turblimp 2026-09-01T00:16:07,705 copying lm_eval/tasks/cabbq/README.md -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:16:07,707 copying lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/lib/lm_eval/tasks/cabbq 2026-09-01T00:16:07,711 copying lm_eval/tasks/tmlu/README.md -> build/lib/lm_eval/tasks/tmlu 2026-09-01T00:16:07,713 copying lm_eval/tasks/tmlu/subject.tsv -> build/lib/lm_eval/tasks/tmlu 2026-09-01T00:16:07,715 copying lm_eval/tasks/tmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/tmlu/default 2026-09-01T00:16:07,719 copying lm_eval/tasks/eq_bench/README.md -> build/lib/lm_eval/tasks/eq_bench 2026-09-01T00:16:07,723 copying lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:16:07,725 copying lm_eval/tasks/catalan_bench/README.md -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:16:07,729 copying lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2026-09-01T00:16:07,734 copying lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:07,736 copying lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:16:07,738 copying lm_eval/tasks/babilong/README.md -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:16:07,742 copying lm_eval/tasks/babilong/_babilong_common_yaml -> build/lib/lm_eval/tasks/babilong 2026-09-01T00:16:07,744 copying lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:07,747 copying lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/lib/lm_eval/tasks/csatqa 2026-09-01T00:16:07,751 copying lm_eval/tasks/mgsm/README.md -> build/lib/lm_eval/tasks/mgsm 2026-09-01T00:16:07,754 copying lm_eval/tasks/mgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/mgsm 2026-09-01T00:16:07,756 copying lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:07,759 copying lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:07,761 copying lm_eval/tasks/mgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/mgsm/direct 2026-09-01T00:16:07,764 copying lm_eval/tasks/meddialog/README.md -> build/lib/lm_eval/tasks/meddialog 2026-09-01T00:16:07,768 copying lm_eval/tasks/belebele/_default_template_yaml -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:16:07,770 copying lm_eval/tasks/belebele/README.md -> build/lib/lm_eval/tasks/belebele 2026-09-01T00:16:07,773 copying lm_eval/tasks/paws-x/pawsx_template_yaml -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:16:07,776 copying lm_eval/tasks/paws-x/README.md -> build/lib/lm_eval/tasks/paws-x 2026-09-01T00:16:07,779 copying lm_eval/tasks/copal_id/README.md -> build/lib/lm_eval/tasks/copal_id 2026-09-01T00:16:07,783 copying lm_eval/tasks/afrimgsm/README.md -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:16:07,786 copying lm_eval/tasks/afrimgsm/run.sh -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:16:07,788 copying lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/afrimgsm 2026-09-01T00:16:07,791 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:07,793 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:07,795 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:07,797 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:07,799 copying lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:07,802 copying lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:07,804 copying lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:07,806 copying lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:07,808 copying lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:07,811 copying lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:07,813 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:07,815 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:07,818 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:07,820 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:07,823 copying lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:07,826 copying lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:07,828 copying lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:07,831 copying lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:07,833 copying lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:07,836 copying lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:07,838 copying lm_eval/tasks/mlqa/README.md -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:16:07,841 copying lm_eval/tasks/mlqa/mlqa_common_yaml -> build/lib/lm_eval/tasks/mlqa 2026-09-01T00:16:07,844 copying lm_eval/tasks/pisa/_template_yaml -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:16:07,847 copying lm_eval/tasks/pisa/README.md -> build/lib/lm_eval/tasks/pisa 2026-09-01T00:16:07,850 copying lm_eval/tasks/click/README.md -> build/lib/lm_eval/tasks/click 2026-09-01T00:16:07,853 copying lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/lib/lm_eval/tasks/click/click_lang 2026-09-01T00:16:07,857 copying lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/lib/lm_eval/tasks/click/click_cul 2026-09-01T00:16:07,859 copying lm_eval/tasks/winogender/README.md -> build/lib/lm_eval/tasks/winogender 2026-09-01T00:16:07,863 copying lm_eval/tasks/hrm8k/README.md -> build/lib/lm_eval/tasks/hrm8k 2026-09-01T00:16:07,866 copying lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/lib/lm_eval/tasks/hrm8k/en 2026-09-01T00:16:07,868 copying lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/lib/lm_eval/tasks/hrm8k/default 2026-09-01T00:16:07,871 copying lm_eval/tasks/indicxnli/README.md -> build/lib/lm_eval/tasks/indicxnli 2026-09-01T00:16:07,874 copying lm_eval/tasks/xstorycloze/README.md -> build/lib/lm_eval/tasks/xstorycloze 2026-09-01T00:16:07,876 copying lm_eval/tasks/groundcocoa/README.md -> build/lib/lm_eval/tasks/groundcocoa 2026-09-01T00:16:07,879 copying lm_eval/tasks/noreval/noreval.jpg -> build/lib/lm_eval/tasks/noreval 2026-09-01T00:16:07,893 copying lm_eval/tasks/noreval/README.md -> build/lib/lm_eval/tasks/noreval 2026-09-01T00:16:07,897 copying lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/lib/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:16:07,900 copying lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/lib/lm_eval/tasks/noreval/norsumm 2026-09-01T00:16:07,903 copying lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/lib/lm_eval/tasks/noreval/norcommonsenseqa 2026-09-01T00:16:07,906 copying lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:16:07,909 copying lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-09-01T00:16:07,913 copying lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/lib/lm_eval/tasks/noreval/tatoeba 2026-09-01T00:16:07,916 copying lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:07,918 copying lm_eval/tasks/noreval/ask_gec/README.md -> build/lib/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:07,921 copying lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/lib/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:07,923 copying lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/lib/lm_eval/tasks/noreval/nrk_quiz_qa 2026-09-01T00:16:07,928 copying lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/lib/lm_eval/tasks/noreval/norquad 2026-09-01T00:16:07,930 copying lm_eval/tasks/noreval/norec/_norec_yaml -> build/lib/lm_eval/tasks/noreval/norec 2026-09-01T00:16:07,933 copying lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/lib/lm_eval/tasks/noreval/noridiom 2026-09-01T00:16:07,937 copying lm_eval/tasks/fda/README.md -> build/lib/lm_eval/tasks/fda 2026-09-01T00:16:07,940 copying lm_eval/tasks/bear/README.md -> build/lib/lm_eval/tasks/bear 2026-09-01T00:16:07,943 copying lm_eval/tasks/lambada_cloze/README.md -> build/lib/lm_eval/tasks/lambada_cloze 2026-09-01T00:16:07,945 copying lm_eval/tasks/babi/README.md -> build/lib/lm_eval/tasks/babi 2026-09-01T00:16:07,948 copying lm_eval/tasks/mastermind/README.md -> build/lib/lm_eval/tasks/mastermind 2026-09-01T00:16:07,950 copying lm_eval/tasks/xquad/README.md -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:16:07,953 copying lm_eval/tasks/xquad/xquad_common_yaml -> build/lib/lm_eval/tasks/xquad 2026-09-01T00:16:07,956 copying lm_eval/tasks/afrixnli/README.md -> build/lib/lm_eval/tasks/afrixnli 2026-09-01T00:16:07,960 copying lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:07,963 copying lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:07,966 copying lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:07,969 copying lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:07,972 copying lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:07,976 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:07,979 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:07,981 copying lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:07,984 copying lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:07,987 copying lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:07,990 copying lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:07,993 copying lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/lib/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:07,996 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:07,999 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:08,001 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:08,004 copying lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:16:08,006 copying lm_eval/tasks/arab_culture/README.md -> build/lib/lm_eval/tasks/arab_culture 2026-09-01T00:16:08,011 copying lm_eval/tasks/pubmedqa/README.md -> build/lib/lm_eval/tasks/pubmedqa 2026-09-01T00:16:08,014 copying lm_eval/tasks/lm_syneval/_template_yaml -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:16:08,016 copying lm_eval/tasks/lm_syneval/README.md -> build/lib/lm_eval/tasks/lm_syneval 2026-09-01T00:16:08,019 copying lm_eval/tasks/agieval/README.md -> build/lib/lm_eval/tasks/agieval 2026-09-01T00:16:08,023 copying lm_eval/tasks/zhoblimp/_template_yaml -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:16:08,025 copying lm_eval/tasks/zhoblimp/README.md -> build/lib/lm_eval/tasks/zhoblimp 2026-09-01T00:16:08,028 copying lm_eval/tasks/mts_dialog/README.md -> build/lib/lm_eval/tasks/mts_dialog 2026-09-01T00:16:08,031 copying lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:08,033 copying lm_eval/tasks/med_concepts_qa/README.md -> build/lib/lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:08,036 copying lm_eval/tasks/bhs/_template_yaml -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:16:08,039 copying lm_eval/tasks/bhs/README.md -> build/lib/lm_eval/tasks/bhs 2026-09-01T00:16:08,041 copying lm_eval/tasks/toksuite/README.md -> build/lib/lm_eval/tasks/toksuite 2026-09-01T00:16:08,045 copying lm_eval/tasks/evalita_llm/_te_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,047 copying lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,049 copying lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,052 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,054 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,056 copying lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,058 copying lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,060 copying lm_eval/tasks/evalita_llm/_re_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,062 copying lm_eval/tasks/evalita_llm/README.md -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,065 copying lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,067 copying lm_eval/tasks/evalita_llm/_at_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,069 copying lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,071 copying lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,074 copying lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,076 copying lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,078 copying lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,080 copying lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/lib/lm_eval/tasks/evalita_llm 2026-09-01T00:16:08,082 copying lm_eval/tasks/infinitebench/_infinitebench_common_yaml -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:16:08,084 copying lm_eval/tasks/infinitebench/README.md -> build/lib/lm_eval/tasks/infinitebench 2026-09-01T00:16:08,087 copying lm_eval/tasks/wsc273/README.md -> build/lib/lm_eval/tasks/wsc273 2026-09-01T00:16:08,090 copying lm_eval/tasks/logiqa/README.md -> build/lib/lm_eval/tasks/logiqa 2026-09-01T00:16:08,093 copying lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:08,096 copying lm_eval/tasks/code_x_glue/code-text/README.md -> build/lib/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:08,099 copying lm_eval/tasks/histoires_morales/README.md -> build/lib/lm_eval/tasks/histoires_morales 2026-09-01T00:16:08,102 copying lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/lib/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:16:08,105 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:08,107 copying lm_eval/tasks/truthfulqa-multi/README.md -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:08,110 copying lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/lib/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:08,113 copying lm_eval/tasks/gpqa/README.md -> build/lib/lm_eval/tasks/gpqa 2026-09-01T00:16:08,117 copying lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:08,120 copying lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:08,125 copying lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:08,128 copying lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:08,132 copying lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/generative 2026-09-01T00:16:08,135 copying lm_eval/tasks/scrolls/README.md -> build/lib/lm_eval/tasks/scrolls 2026-09-01T00:16:08,138 copying lm_eval/tasks/hendrycks_math/README.md -> build/lib/lm_eval/tasks/hendrycks_math 2026-09-01T00:16:08,141 copying lm_eval/tasks/mmlu_prox/README.md -> build/lib/lm_eval/tasks/mmlu_prox 2026-09-01T00:16:08,145 copying lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:08,148 copying lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:08,150 copying lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:08,153 copying lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:08,156 copying lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:08,158 copying lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:08,161 copying lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:08,163 copying lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:08,165 copying lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:08,168 copying lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:08,170 copying lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:08,172 copying lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:08,175 copying lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:08,178 copying lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:08,180 copying lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:08,183 copying lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:08,185 copying lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:08,187 copying lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:08,190 copying lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:08,192 copying lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:08,195 copying lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:08,197 copying lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:08,200 copying lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:08,202 copying lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:08,205 copying lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:08,207 copying lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:08,210 copying lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:08,212 copying lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:08,215 copying lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:16:08,218 copying lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:08,220 copying lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:08,223 copying lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:08,225 copying lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:08,228 copying lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:08,230 copying lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:08,233 copying lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:08,235 copying lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:08,238 copying lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:08,241 copying lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:08,243 copying lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:08,246 copying lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:08,248 copying lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:08,251 copying lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:08,253 copying lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:08,255 copying lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:08,258 copying lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:08,260 copying lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:08,263 copying lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:08,265 copying lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:08,268 copying lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:08,270 copying lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:08,273 copying lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:08,275 copying lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:08,278 copying lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:08,280 copying lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:08,283 copying lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:08,285 copying lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:08,288 copying lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:08,290 copying lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/lib/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:08,292 copying lm_eval/tasks/inverse_scaling/_some_results -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:16:08,295 copying lm_eval/tasks/inverse_scaling/README.md -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:16:08,297 copying lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/lib/lm_eval/tasks/inverse_scaling 2026-09-01T00:16:08,300 copying lm_eval/tasks/xnli/README.md -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:16:08,302 copying lm_eval/tasks/xnli/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli 2026-09-01T00:16:08,305 copying lm_eval/tasks/tinyBenchmarks/README.md -> build/lib/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:08,310 copying lm_eval/tasks/kmmlu/README.md -> build/lib/lm_eval/tasks/kmmlu 2026-09-01T00:16:08,312 copying lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:08,315 copying lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:08,317 copying lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:08,319 copying lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:08,322 copying lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/default 2026-09-01T00:16:08,324 copying lm_eval/tasks/meqsum/README.md -> build/lib/lm_eval/tasks/meqsum 2026-09-01T00:16:08,328 copying lm_eval/tasks/glianorex/README.md -> build/lib/lm_eval/tasks/glianorex 2026-09-01T00:16:08,330 copying lm_eval/tasks/egyhellaswag/README.md -> build/lib/lm_eval/tasks/egyhellaswag 2026-09-01T00:16:08,333 copying lm_eval/tasks/swde/README.md -> build/lib/lm_eval/tasks/swde 2026-09-01T00:16:08,336 copying lm_eval/tasks/cnn_dailymail/README.md -> build/lib/lm_eval/tasks/cnn_dailymail 2026-09-01T00:16:08,339 copying lm_eval/tasks/aclue/_default_template_yaml -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:16:08,341 copying lm_eval/tasks/aclue/README.md -> build/lib/lm_eval/tasks/aclue 2026-09-01T00:16:08,344 copying lm_eval/tasks/arabic_leaderboard_light/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:16:08,358 copying lm_eval/tasks/lambada/README.md -> build/lib/lm_eval/tasks/lambada 2026-09-01T00:16:08,360 copying lm_eval/tasks/chartqa/README.md -> build/lib/lm_eval/tasks/chartqa 2026-09-01T00:16:08,363 copying lm_eval/tasks/jsonschema_bench/README.md -> build/lib/lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:08,366 copying lm_eval/tasks/physics_gre/_physics_gre_template_yaml -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:16:08,368 copying lm_eval/tasks/physics_gre/README.md -> build/lib/lm_eval/tasks/physics_gre 2026-09-01T00:16:08,371 copying lm_eval/tasks/legalbench/README.md -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:16:08,374 copying lm_eval/tasks/legalbench/_legalbench_template_yaml -> build/lib/lm_eval/tasks/legalbench 2026-09-01T00:16:08,376 copying lm_eval/tasks/slr_bench/slr_bench_common_yaml -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:16:08,378 copying lm_eval/tasks/slr_bench/README.md -> build/lib/lm_eval/tasks/slr_bench 2026-09-01T00:16:08,381 copying lm_eval/tasks/fld/README.md -> build/lib/lm_eval/tasks/fld 2026-09-01T00:16:08,383 copying lm_eval/tasks/squad_completion/README.md -> build/lib/lm_eval/tasks/squad_completion 2026-09-01T00:16:08,386 copying lm_eval/tasks/asdiv/README.md -> build/lib/lm_eval/tasks/asdiv 2026-09-01T00:16:08,389 copying lm_eval/tasks/global_mmlu/README.md -> build/lib/lm_eval/tasks/global_mmlu 2026-09-01T00:16:08,395 copying lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:08,399 copying lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:08,402 copying lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:08,405 copying lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:08,408 copying lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:08,411 copying lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:08,416 copying lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:08,419 copying lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:08,421 copying lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:08,424 copying lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:08,427 copying lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:08,431 copying lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:08,434 copying lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:08,437 copying lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:08,440 copying lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:08,443 copying lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:08,446 copying lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:08,449 copying lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:08,452 copying lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:08,455 copying lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:08,457 copying lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:08,461 copying lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:08,464 copying lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:08,467 copying lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:08,469 copying lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:08,472 copying lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:08,475 copying lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:08,478 copying lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:08,481 copying lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:08,484 copying lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:08,487 copying lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:08,490 copying lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:08,493 copying lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:08,495 copying lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:08,499 copying lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:08,501 copying lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:08,504 copying lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:08,507 copying lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:08,511 copying lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:08,514 copying lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:08,516 copying lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:08,519 copying lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:08,522 copying lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:08,526 copying lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:08,529 copying lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:08,532 copying lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:08,534 copying lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:08,537 copying lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:08,540 copying lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:08,543 copying lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:08,546 copying lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:08,548 copying lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:08,551 copying lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:08,555 copying lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:08,557 copying lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:08,560 copying lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:08,562 copying lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/lib/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:08,565 copying lm_eval/tasks/longbench2/_longbench_common_yaml -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:16:08,567 copying lm_eval/tasks/longbench2/README.md -> build/lib/lm_eval/tasks/longbench2 2026-09-01T00:16:08,571 copying lm_eval/tasks/japanese_leaderboard/README.md -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:08,575 copying lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/lib/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:08,578 copying lm_eval/tasks/basque_bench/README.md -> build/lib/lm_eval/tasks/basque_bench 2026-09-01T00:16:08,581 copying lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:08,584 copying lm_eval/tasks/french_bench/_default_template_yaml -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:16:08,587 copying lm_eval/tasks/french_bench/README.md -> build/lib/lm_eval/tasks/french_bench 2026-09-01T00:16:08,590 copying lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:16:08,592 copying lm_eval/tasks/darijammlu/README.md -> build/lib/lm_eval/tasks/darijammlu 2026-09-01T00:16:08,596 copying lm_eval/tasks/kormedmcqa/_template_yaml -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:16:08,598 copying lm_eval/tasks/kormedmcqa/README.md -> build/lib/lm_eval/tasks/kormedmcqa 2026-09-01T00:16:08,602 copying lm_eval/tasks/cmmlu/_default_template_yaml -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:16:08,604 copying lm_eval/tasks/cmmlu/README.md -> build/lib/lm_eval/tasks/cmmlu 2026-09-01T00:16:08,607 copying lm_eval/tasks/mmmu/_template_yaml -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:16:08,609 copying lm_eval/tasks/mmmu/README.md -> build/lib/lm_eval/tasks/mmmu 2026-09-01T00:16:08,613 copying lm_eval/tasks/eus_trivia/README.md -> build/lib/lm_eval/tasks/eus_trivia 2026-09-01T00:16:08,616 copying lm_eval/tasks/include/README.md -> build/lib/lm_eval/tasks/include 2026-09-01T00:16:08,620 copying lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:08,622 copying lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:08,625 copying lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:08,629 copying lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:08,632 copying lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:08,635 copying lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:08,638 copying lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:08,640 copying lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:08,644 copying lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:08,647 copying lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:08,649 copying lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:08,653 copying lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:08,655 copying lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:08,658 copying lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:08,661 copying lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:08,664 copying lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:08,668 copying lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:08,671 copying lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:08,674 copying lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:08,677 copying lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:08,680 copying lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:08,683 copying lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:08,687 copying lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:08,689 copying lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:08,692 copying lm_eval/tasks/include/few_shot_en/North Macedonian/_north_macedonian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:08,695 copying lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:08,699 copying lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:08,702 copying lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:16:08,705 copying lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:08,708 copying lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:08,712 copying lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:08,714 copying lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:08,718 copying lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:08,721 copying lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:08,724 copying lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:08,727 copying lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:08,730 copying lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:08,733 copying lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:08,736 copying lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:08,740 copying lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:16:08,744 copying lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:16:08,747 copying lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:08,750 copying lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:08,754 copying lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:08,756 copying lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:08,760 copying lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:08,763 copying lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:08,767 copying lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:08,769 copying lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:08,772 copying lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:08,776 copying lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:08,780 copying lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:08,782 copying lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:08,786 copying lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:08,790 copying lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:08,793 copying lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:08,795 copying lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:08,798 copying lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:08,802 copying lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:08,805 copying lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:08,808 copying lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:08,812 copying lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:08,816 copying lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:08,819 copying lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:08,822 copying lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:08,826 copying lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:08,830 copying lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:08,835 copying lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:08,837 copying lm_eval/tasks/include/few_shot_og/North Macedonian/_north_macedonian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:08,840 copying lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:08,845 copying lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:08,849 copying lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:16:08,854 copying lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:08,858 copying lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:08,864 copying lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:08,869 copying lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:08,872 copying lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:08,875 copying lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:08,878 copying lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:08,881 copying lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:08,884 copying lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:08,887 copying lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:08,890 copying lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:08,894 copying lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:16:08,898 copying lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:16:08,901 copying lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:08,904 copying lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:08,907 copying lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/lib/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:08,910 copying lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/lib/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:08,913 copying lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/lib/lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:08,916 copying lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/lib/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:08,920 copying lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:08,923 copying lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/lib/lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:08,927 copying lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/lib/lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:08,929 copying lm_eval/tasks/include/default/French/_french_template_yaml -> build/lib/lm_eval/tasks/include/default/French 2026-09-01T00:16:08,933 copying lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/lib/lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:08,936 copying lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/lib/lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:08,940 copying lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/lib/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:08,943 copying lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/lib/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:08,945 copying lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/lib/lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:08,949 copying lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/lib/lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:08,952 copying lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/lib/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:08,956 copying lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:08,959 copying lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/lib/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:08,961 copying lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/lib/lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:08,964 copying lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/lib/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:08,968 copying lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/lib/lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:08,971 copying lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/lib/lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:08,974 copying lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/lib/lm_eval/tasks/include/default/Italian 2026-09-01T00:16:08,977 copying lm_eval/tasks/include/default/German/_german_template_yaml -> build/lib/lm_eval/tasks/include/default/German 2026-09-01T00:16:08,980 copying lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/lib/lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:08,984 copying lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/lib/lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:08,987 copying lm_eval/tasks/include/default/North Macedonian/_north_macedonian_template_yaml -> build/lib/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:08,990 copying lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/lib/lm_eval/tasks/include/default/Persian 2026-09-01T00:16:08,993 copying lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/lib/lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:08,996 copying lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/lib/lm_eval/tasks/include/default/Basque 2026-09-01T00:16:08,999 copying lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/lib/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:09,002 copying lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/lib/lm_eval/tasks/include/default/Greek 2026-09-01T00:16:09,006 copying lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/lib/lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:09,009 copying lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/lib/lm_eval/tasks/include/default/Polish 2026-09-01T00:16:09,012 copying lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/lib/lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:09,014 copying lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/lib/lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:09,017 copying lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/lib/lm_eval/tasks/include/default/Malay 2026-09-01T00:16:09,020 copying lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/lib/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:09,023 copying lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/lib/lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:09,026 copying lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/lib/lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:09,028 copying lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/lib/lm_eval/tasks/include/default/Korean 2026-09-01T00:16:09,032 copying lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/lib/lm_eval/tasks/include/default/Georgian 2026-09-01T00:16:09,034 copying lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/lib/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:16:09,037 copying lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/lib/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:09,039 copying lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/lib/lm_eval/tasks/include/default/Russian 2026-09-01T00:16:09,042 copying lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/lib/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:09,047 copying lm_eval/tasks/longbench/README.md -> build/lib/lm_eval/tasks/longbench 2026-09-01T00:16:09,050 copying lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:09,053 copying lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:09,056 copying lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:09,058 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:09,060 copying lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:09,062 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:09,064 copying lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:09,066 copying lm_eval/tasks/okapi/arc_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:09,069 copying lm_eval/tasks/kobest/README.md -> build/lib/lm_eval/tasks/kobest 2026-09-01T00:16:09,073 copying lm_eval/tasks/portuguese_bench/README.md -> build/lib/lm_eval/tasks/portuguese_bench 2026-09-01T00:16:09,077 copying lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:09,079 copying lm_eval/tasks/wmdp/_default_template_yaml -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:16:09,081 copying lm_eval/tasks/wmdp/README.md -> build/lib/lm_eval/tasks/wmdp 2026-09-01T00:16:09,084 copying lm_eval/tasks/longproc/_default_yaml_0.5k -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:16:09,086 copying lm_eval/tasks/longproc/README.md -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:16:09,089 copying lm_eval/tasks/longproc/_default_yaml_8k -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:16:09,091 copying lm_eval/tasks/longproc/_default_yaml_2k -> build/lib/lm_eval/tasks/longproc 2026-09-01T00:16:09,093 copying lm_eval/tasks/pile/README.md -> build/lib/lm_eval/tasks/pile 2026-09-01T00:16:09,095 copying lm_eval/tasks/commonsense_qa/README.md -> build/lib/lm_eval/tasks/commonsense_qa 2026-09-01T00:16:09,098 copying lm_eval/tasks/mathqa/README.md -> build/lib/lm_eval/tasks/mathqa 2026-09-01T00:16:09,101 copying lm_eval/tasks/tmmluplus/README.md -> build/lib/lm_eval/tasks/tmmluplus 2026-09-01T00:16:09,103 copying lm_eval/tasks/tmmluplus/subject.tsv -> build/lib/lm_eval/tasks/tmmluplus 2026-09-01T00:16:09,106 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:09,109 copying lm_eval/tasks/benchmarks/README.md -> build/lib/lm_eval/tasks/benchmarks 2026-09-01T00:16:09,111 copying lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2026-09-01T00:16:09,114 copying lm_eval/tasks/benchmarks/multimedqa/README.md -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:16:09,116 copying lm_eval/tasks/crows_pairs/README.md -> build/lib/lm_eval/tasks/crows_pairs 2026-09-01T00:16:09,120 copying lm_eval/tasks/bertaqa/_bertaqa_template -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:16:09,122 copying lm_eval/tasks/bertaqa/README.md -> build/lib/lm_eval/tasks/bertaqa 2026-09-01T00:16:09,124 copying lm_eval/tasks/darijahellaswag/README.md -> build/lib/lm_eval/tasks/darijahellaswag 2026-09-01T00:16:09,127 copying lm_eval/tasks/alghafa/piqa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:16:09,129 copying lm_eval/tasks/alghafa/copa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:16:09,132 copying lm_eval/tasks/bbh/README.md -> build/lib/lm_eval/tasks/bbh 2026-09-01T00:16:09,135 copying lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:09,138 copying lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:09,140 copying lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:09,142 copying lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:09,145 copying lm_eval/tasks/discrim_eval/README.md -> build/lib/lm_eval/tasks/discrim_eval 2026-09-01T00:16:09,148 copying lm_eval/tasks/arabicmmlu/README.md -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:16:09,150 copying lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/lib/lm_eval/tasks/arabicmmlu 2026-09-01T00:16:09,153 creating build/lib/lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:16:09,154 copying lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/lib/lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:16:09,156 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:09,159 copying lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:09,162 copying lm_eval/tasks/super_glue/README.md -> build/lib/lm_eval/tasks/super_glue 2026-09-01T00:16:09,170 copying lm_eval/tasks/toxigen/README.md -> build/lib/lm_eval/tasks/toxigen 2026-09-01T00:16:09,172 copying lm_eval/tasks/eus_reading/README.md -> build/lib/lm_eval/tasks/eus_reading 2026-09-01T00:16:09,175 copying lm_eval/tasks/ceval/_default_ceval_yaml -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:16:09,177 copying lm_eval/tasks/ceval/README.md -> build/lib/lm_eval/tasks/ceval 2026-09-01T00:16:09,180 copying lm_eval/tasks/mela/README.md -> build/lib/lm_eval/tasks/mela 2026-09-01T00:16:09,183 copying lm_eval/tasks/aexams/_default_template_yaml -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:16:09,185 copying lm_eval/tasks/aexams/README.md -> build/lib/lm_eval/tasks/aexams 2026-09-01T00:16:09,187 copying lm_eval/tasks/arc_mt/README.md -> build/lib/lm_eval/tasks/arc_mt 2026-09-01T00:16:09,189 copying lm_eval/tasks/triviaqa/README.md -> build/lib/lm_eval/tasks/triviaqa 2026-09-01T00:16:09,192 copying lm_eval/tasks/haerae/_default_haerae_yaml -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:16:09,194 copying lm_eval/tasks/haerae/README.md -> build/lib/lm_eval/tasks/haerae 2026-09-01T00:16:09,196 copying lm_eval/tasks/gsm8k/README.md -> build/lib/lm_eval/tasks/gsm8k 2026-09-01T00:16:09,199 copying lm_eval/tasks/qa4mre/README.md -> build/lib/lm_eval/tasks/qa4mre 2026-09-01T00:16:09,201 copying lm_eval/tasks/basqueglue/README.md -> build/lib/lm_eval/tasks/basqueglue 2026-09-01T00:16:09,204 copying lm_eval/tasks/coqa/README.md -> build/lib/lm_eval/tasks/coqa 2026-09-01T00:16:09,207 copying lm_eval/tasks/afrimmlu/README.md -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:16:09,210 copying lm_eval/tasks/afrimmlu/fewshot.sh -> build/lib/lm_eval/tasks/afrimmlu 2026-09-01T00:16:09,214 copying lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:09,217 copying lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:09,220 copying lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:09,223 copying lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:09,226 copying lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:09,229 copying lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:09,232 copying lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:09,235 copying lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:09,238 copying lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:09,241 copying lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:09,244 copying lm_eval/tasks/headqa/README.md -> build/lib/lm_eval/tasks/headqa 2026-09-01T00:16:09,246 copying lm_eval/tasks/humaneval/README.md -> build/lib/lm_eval/tasks/humaneval 2026-09-01T00:16:09,249 copying lm_eval/tasks/gsm8k_platinum/README.md -> build/lib/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:09,251 copying lm_eval/tasks/score/README.md -> build/lib/lm_eval/tasks/score 2026-09-01T00:16:09,254 copying lm_eval/tasks/score/NON_GREEDY.md -> build/lib/lm_eval/tasks/score 2026-09-01T00:16:09,257 copying lm_eval/tasks/score/non_greedy.sh -> build/lib/lm_eval/tasks/score 2026-09-01T00:16:09,260 copying lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/lib/lm_eval/tasks/score/agi_eval 2026-09-01T00:16:09,264 copying lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:16:09,267 copying lm_eval/tasks/score/math/prompt_templates.json -> build/lib/lm_eval/tasks/score/math 2026-09-01T00:16:09,270 copying lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/lib/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:09,272 copying lm_eval/tasks/spanish_bench/README.md -> build/lib/lm_eval/tasks/spanish_bench 2026-09-01T00:16:09,276 copying lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:09,279 copying lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:16:09,282 copying lm_eval/tasks/careqa/README.md -> build/lib/lm_eval/tasks/careqa 2026-09-01T00:16:09,285 copying lm_eval/tasks/piqa/README.md -> build/lib/lm_eval/tasks/piqa 2026-09-01T00:16:09,287 copying lm_eval/tasks/global_piqa/README.md -> build/lib/lm_eval/tasks/global_piqa 2026-09-01T00:16:09,291 copying lm_eval/tasks/global_piqa/parallel_generation/_template -> build/lib/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:09,294 copying lm_eval/tasks/global_piqa/nonparallel_cloze/_template -> build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:09,297 copying lm_eval/tasks/global_piqa/parallel_cloze/_template -> build/lib/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:09,300 copying lm_eval/tasks/global_piqa/nonparallel_generation/_template -> build/lib/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:09,302 copying lm_eval/tasks/drop/README.md -> build/lib/lm_eval/tasks/drop 2026-09-01T00:16:09,305 copying lm_eval/tasks/storycloze/README.md -> build/lib/lm_eval/tasks/storycloze 2026-09-01T00:16:09,308 copying lm_eval/tasks/nq_open/README.md -> build/lib/lm_eval/tasks/nq_open 2026-09-01T00:16:09,310 copying lm_eval/tasks/indicparam/README.md -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:16:09,313 copying lm_eval/tasks/indicparam/_default_indicparam_template_yaml -> build/lib/lm_eval/tasks/indicparam 2026-09-01T00:16:09,316 copying lm_eval/tasks/uncheatable_eval/README.md -> build/lib/lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:09,318 copying lm_eval/tasks/mmlu-redux-spanish/README.md -> build/lib/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:16:09,321 copying lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/lib/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:09,324 copying lm_eval/tasks/mediqa_qa2019/README.md -> build/lib/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:09,328 copying lm_eval/tasks/webqs/README.md -> build/lib/lm_eval/tasks/webqs 2026-09-01T00:16:09,330 copying lm_eval/tasks/gsm_plus/README.md -> build/lib/lm_eval/tasks/gsm_plus 2026-09-01T00:16:09,333 copying lm_eval/tasks/logiqa2/README.md -> build/lib/lm_eval/tasks/logiqa2 2026-09-01T00:16:09,336 copying lm_eval/tasks/afrobench/README.md -> build/lib/lm_eval/tasks/afrobench 2026-09-01T00:16:09,338 copying lm_eval/tasks/afrobench/adr/README.md -> build/lib/lm_eval/tasks/afrobench/adr 2026-09-01T00:16:09,341 copying lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:09,343 copying lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:09,345 copying lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:09,347 copying lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:09,349 copying lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/lib/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:09,352 copying lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:16:09,355 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:09,358 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:09,360 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:09,363 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:09,366 copying lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:09,369 copying lm_eval/tasks/afrobench/salt/README.md -> build/lib/lm_eval/tasks/afrobench/salt 2026-09-01T00:16:09,372 copying lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:09,374 copying lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:09,376 copying lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/lib/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:09,378 copying lm_eval/tasks/afrobench/belebele/README.md -> build/lib/lm_eval/tasks/afrobench/belebele 2026-09-01T00:16:09,381 copying lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:09,384 copying lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:09,386 copying lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:09,388 copying lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:09,390 copying lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/lib/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:09,393 copying lm_eval/tasks/afrobench/masakhapos/README.md -> build/lib/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:16:09,397 copying lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:09,401 copying lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:09,404 copying lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:09,407 copying lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:09,410 copying lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:09,413 copying lm_eval/tasks/afrobench/injongointent/README.md -> build/lib/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:16:09,416 copying lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:09,419 copying lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:09,422 copying lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:09,425 copying lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:09,428 copying lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:09,431 creating build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:16:09,432 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:16:09,435 copying lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/lib/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:16:09,437 copying lm_eval/tasks/afrobench/masakhanews/README.md -> build/lib/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:16:09,441 copying lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:09,444 copying lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:09,447 copying lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:09,450 copying lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:09,453 copying lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:09,456 copying lm_eval/tasks/afrobench/afriqa/README.md -> build/lib/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:16:09,459 copying lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:09,462 copying lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:09,466 copying lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:09,470 copying lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:09,473 copying lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:09,476 copying lm_eval/tasks/afrobench/mafand/README.md -> build/lib/lm_eval/tasks/afrobench/mafand 2026-09-01T00:16:09,480 copying lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:09,483 copying lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:09,487 copying lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:09,490 copying lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:09,494 copying lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:09,497 copying lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:09,501 copying lm_eval/tasks/afrobench/afrisenti/README.md -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:09,504 copying lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:09,507 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:09,510 copying lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:09,513 copying lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:09,517 copying lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:09,521 copying lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:09,525 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:09,528 copying lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:09,531 copying lm_eval/tasks/afrobench/ntrex/README.md -> build/lib/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:16:09,534 copying lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:09,537 copying lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:09,539 copying lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:09,541 copying lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:09,544 copying lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:09,547 copying lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:09,549 copying lm_eval/tasks/afrobench/nollysenti/README.md -> build/lib/lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:16:09,552 copying lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:09,556 copying lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:09,559 copying lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:09,562 copying lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:09,565 copying lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:09,567 copying lm_eval/tasks/afrobench/flores/README.md -> build/lib/lm_eval/tasks/afrobench/flores 2026-09-01T00:16:09,571 copying lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1 2026-09-01T00:16:09,573 copying lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:09,576 copying lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:09,579 copying lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3 2026-09-01T00:16:09,581 copying lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:09,584 copying lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:09,587 copying lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2 2026-09-01T00:16:09,589 copying lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:09,592 copying lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:09,594 copying lm_eval/tasks/afrobench/naijarc/README.md -> build/lib/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:16:09,597 copying lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:09,600 copying lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:09,602 copying lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:09,605 copying lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:09,607 copying lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:09,609 copying lm_eval/tasks/afrobench/masakhaner/README.md -> build/lib/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:16:09,613 copying lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:09,616 copying lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:09,619 copying lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:09,623 copying lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:09,626 copying lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:09,629 copying lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/lib/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:16:09,632 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:09,635 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:09,637 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:09,640 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:09,643 copying lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:09,645 copying lm_eval/tasks/afrobench/xlsum/README.md -> build/lib/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:16:09,649 copying lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:09,652 copying lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:09,656 copying lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:09,659 copying lm_eval/tasks/afrobench/sib/README.md -> build/lib/lm_eval/tasks/afrobench/sib 2026-09-01T00:16:09,663 copying lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:09,666 copying lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:09,669 copying lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:09,672 copying lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:09,675 copying lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/lib/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:09,678 copying lm_eval/tasks/mmlusr/README.md -> build/lib/lm_eval/tasks/mmlusr 2026-09-01T00:16:09,681 copying lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:09,684 copying lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:09,687 copying lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/lib/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:09,692 copying lm_eval/tasks/ifeval/README.md -> build/lib/lm_eval/tasks/ifeval 2026-09-01T00:16:09,701 copying lm_eval/tasks/darija_bench/README.md -> build/lib/lm_eval/tasks/darija_bench 2026-09-01T00:16:09,704 copying lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:09,707 copying lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:09,710 copying lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:09,712 copying lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:09,716 copying lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:09,718 copying lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:09,721 copying lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:09,723 copying lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:09,726 copying lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:09,728 copying lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:09,730 copying lm_eval/tasks/darija_bench/darija_translation/README.md -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:09,733 copying lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/lib/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:09,736 copying lm_eval/tasks/humaneval_infilling/README.md -> build/lib/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:09,739 copying lm_eval/tasks/unitxt/README.md -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:09,741 copying lm_eval/tasks/unitxt/unitxt_multimodal -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:09,744 copying lm_eval/tasks/unitxt/unitxt -> build/lib/lm_eval/tasks/unitxt 2026-09-01T00:16:09,747 copying lm_eval/tasks/turkishmmlu/README.md -> build/lib/lm_eval/tasks/turkishmmlu 2026-09-01T00:16:09,750 copying lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:09,752 copying lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:09,754 copying lm_eval/tasks/llama3/README.md -> build/lib/lm_eval/tasks/llama3 2026-09-01T00:16:09,757 copying lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:09,760 copying lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:09,763 copying lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:09,766 copying lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:09,769 copying lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:09,772 copying lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:09,775 copying lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:09,777 copying lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:09,779 copying lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:09,782 copying lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:09,785 copying lm_eval/tasks/mutual/README.md -> build/lib/lm_eval/tasks/mutual 2026-09-01T00:16:09,788 copying lm_eval/tasks/aradice/README.md -> build/lib/lm_eval/tasks/aradice 2026-09-01T00:16:09,799 copying lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:09,803 copying lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:09,807 copying lm_eval/tasks/eus_proficiency/README.md -> build/lib/lm_eval/tasks/eus_proficiency 2026-09-01T00:16:09,809 copying lm_eval/tasks/bbq/README.md -> build/lib/lm_eval/tasks/bbq 2026-09-01T00:16:09,812 copying lm_eval/tasks/tydiqa/_tydiqa_goldp_common_yaml -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:09,814 copying lm_eval/tasks/tydiqa/README.md -> build/lib/lm_eval/tasks/tydiqa 2026-09-01T00:16:09,817 copying lm_eval/tasks/mmlu/README.md -> build/lib/lm_eval/tasks/mmlu 2026-09-01T00:16:09,820 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:09,823 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:09,826 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:09,828 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:09,830 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:09,836 copying lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:09,839 copying lm_eval/tasks/mmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/default 2026-09-01T00:16:09,841 copying lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:09,844 copying lm_eval/tasks/wikitext/README.md -> build/lib/lm_eval/tasks/wikitext 2026-09-01T00:16:09,846 copying lm_eval/tasks/pile_10k/README.md -> build/lib/lm_eval/tasks/pile_10k 2026-09-01T00:16:09,850 copying lm_eval/tasks/medtext/README.md -> build/lib/lm_eval/tasks/medtext 2026-09-01T00:16:09,853 copying lm_eval/tasks/noticia/README.md -> build/lib/lm_eval/tasks/noticia 2026-09-01T00:16:09,856 copying lm_eval/tasks/olaph/README.md -> build/lib/lm_eval/tasks/olaph 2026-09-01T00:16:09,859 copying lm_eval/tasks/race/README.md -> build/lib/lm_eval/tasks/race 2026-09-01T00:16:09,862 copying lm_eval/tasks/metabench/README.md -> build/lib/lm_eval/tasks/metabench 2026-09-01T00:16:09,866 copying lm_eval/tasks/xwinograd/README.md -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:09,869 copying lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/lib/lm_eval/tasks/xwinograd 2026-09-01T00:16:09,871 copying lm_eval/tasks/lambada_multilingual/README.md -> build/lib/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:09,873 copying lm_eval/tasks/anli/README.md -> build/lib/lm_eval/tasks/anli 2026-09-01T00:16:09,875 copying lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:09,877 copying lm_eval/tasks/arab_culture_completion/README.md -> build/lib/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:09,882 copying lm_eval/tasks/paloma/_paloma_template -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:09,884 copying lm_eval/tasks/paloma/README.md -> build/lib/lm_eval/tasks/paloma 2026-09-01T00:16:09,886 copying lm_eval/tasks/graphwalks/README.md -> build/lib/lm_eval/tasks/graphwalks 2026-09-01T00:16:09,889 copying lm_eval/tasks/prost/README.md -> build/lib/lm_eval/tasks/prost 2026-09-01T00:16:09,891 copying lm_eval/tasks/moral_stories/README.md -> build/lib/lm_eval/tasks/moral_stories 2026-09-01T00:16:09,894 copying lm_eval/tasks/sciq/README.md -> build/lib/lm_eval/tasks/sciq 2026-09-01T00:16:09,896 copying lm_eval/tasks/swag/README.md -> build/lib/lm_eval/tasks/swag 2026-09-01T00:16:09,899 copying lm_eval/tasks/putnam_axiom/README.md -> build/lib/lm_eval/tasks/putnam_axiom 2026-09-01T00:16:09,902 copying lm_eval/tasks/arc/README.md -> build/lib/lm_eval/tasks/arc 2026-09-01T00:16:09,905 copying lm_eval/tasks/glue/README.md -> build/lib/lm_eval/tasks/glue 2026-09-01T00:16:09,909 copying lm_eval/tasks/qasper/README.md -> build/lib/lm_eval/tasks/qasper 2026-09-01T00:16:09,912 copying lm_eval/tasks/hellaswag/README.md -> build/lib/lm_eval/tasks/hellaswag 2026-09-01T00:16:09,915 copying lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:09,917 copying lm_eval/tasks/esbbq/README.md -> build/lib/lm_eval/tasks/esbbq 2026-09-01T00:16:09,920 copying lm_eval/tasks/jfinqa/README.md -> build/lib/lm_eval/tasks/jfinqa 2026-09-01T00:16:09,924 copying lm_eval/tasks/bigbench/generate_until_template_yaml -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:16:09,926 copying lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:16:09,928 copying lm_eval/tasks/bigbench/README.md -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:16:09,932 copying lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/lib/lm_eval/tasks/bigbench 2026-09-01T00:16:09,935 copying lm_eval/tasks/e2lmc/noor/_noor_template -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:09,937 copying lm_eval/tasks/e2lmc/noor/README.md -> build/lib/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:09,941 copying lm_eval/tasks/e2lmc/mmlu_early_training/README.md -> build/lib/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:16:09,943 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:09,946 copying lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md -> build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:09,948 copying lm_eval/tasks/xnli_eu/README.md -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:16:09,951 copying lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli_eu 2026-09-01T00:16:09,953 copying lm_eval/tasks/leaderboard/README.md -> build/lib/lm_eval/tasks/leaderboard 2026-09-01T00:16:09,956 copying lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:09,958 copying lm_eval/tasks/leaderboard/math/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:09,964 copying lm_eval/tasks/leaderboard/musr/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:09,967 copying lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:09,970 copying lm_eval/tasks/blimp/_template_yaml -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:09,972 copying lm_eval/tasks/blimp/README.md -> build/lib/lm_eval/tasks/blimp 2026-09-01T00:16:09,974 copying lm_eval/tasks/nerel-bench/_template_yaml -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:16:09,976 copying lm_eval/tasks/nerel-bench/README.md -> build/lib/lm_eval/tasks/nerel-bench 2026-09-01T00:16:09,980 copying lm_eval/tasks/minerva_math/README.md -> build/lib/lm_eval/tasks/minerva_math 2026-09-01T00:16:09,983 copying lm_eval/tasks/unscramble/README.md -> build/lib/lm_eval/tasks/unscramble 2026-09-01T00:16:09,985 copying lm_eval/tasks/squadv2/README.md -> build/lib/lm_eval/tasks/squadv2 2026-09-01T00:16:09,988 copying lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:09,990 copying lm_eval/tasks/mmlu_pro/README.md -> build/lib/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:09,993 copying lm_eval/tasks/multiblimp/_template_yaml -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:09,996 copying lm_eval/tasks/multiblimp/README.md -> build/lib/lm_eval/tasks/multiblimp 2026-09-01T00:16:09,999 copying lm_eval/tasks/polemo2/README.md -> build/lib/lm_eval/tasks/polemo2 2026-09-01T00:16:10,002 copying lm_eval/tasks/kbl/README.md -> build/lib/lm_eval/tasks/kbl 2026-09-01T00:16:10,004 copying lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:10,007 copying lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:10,009 copying lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:10,012 copying lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:10,014 copying lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:10,017 copying lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:10,019 copying lm_eval/tasks/libra/_template_yaml -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:10,021 copying lm_eval/tasks/libra/README.md -> build/lib/lm_eval/tasks/libra 2026-09-01T00:16:10,024 copying lm_eval/tasks/winogrande/README.md -> build/lib/lm_eval/tasks/winogrande 2026-09-01T00:16:10,027 copying lm_eval/tasks/mc_taco/README.md -> build/lib/lm_eval/tasks/mc_taco 2026-09-01T00:16:10,029 copying lm_eval/tasks/arithmetic/README.md -> build/lib/lm_eval/tasks/arithmetic 2026-09-01T00:16:10,032 copying lm_eval/tasks/bangla/README.md -> build/lib/lm_eval/tasks/bangla 2026-09-01T00:16:19,760 installing to build/bdist.linux-armv7l/wheel 2026-09-01T00:16:19,761 running install 2026-09-01T00:16:19,784 running install_lib 2026-09-01T00:16:19,790 creating build/bdist.linux-armv7l/wheel 2026-09-01T00:16:19,792 creating build/bdist.linux-armv7l/wheel/lm_eval 2026-09-01T00:16:19,795 creating build/bdist.linux-armv7l/wheel/lm_eval/caching 2026-09-01T00:16:19,796 copying build/lib/lm_eval/caching/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2026-09-01T00:16:19,798 copying build/lib/lm_eval/caching/cache.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2026-09-01T00:16:19,801 creating build/bdist.linux-armv7l/wheel/lm_eval/filters 2026-09-01T00:16:19,803 copying build/lib/lm_eval/filters/selection.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:16:19,805 copying build/lib/lm_eval/filters/custom.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:16:19,807 copying build/lib/lm_eval/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:16:19,809 copying build/lib/lm_eval/filters/extraction.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:16:19,812 copying build/lib/lm_eval/filters/transformation.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:16:19,814 copying build/lib/lm_eval/filters/decontamination.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2026-09-01T00:16:19,816 copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:19,820 creating build/bdist.linux-armv7l/wheel/lm_eval/config 2026-09-01T00:16:19,821 copying build/lib/lm_eval/config/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:16:19,823 copying build/lib/lm_eval/config/evaluate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:16:19,826 copying build/lib/lm_eval/config/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:16:19,829 copying build/lib/lm_eval/config/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/config 2026-09-01T00:16:19,832 creating build/bdist.linux-armv7l/wheel/lm_eval/models 2026-09-01T00:16:19,833 copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,836 copying build/lib/lm_eval/models/trtllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,839 copying build/lib/lm_eval/models/nemo_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,842 copying build/lib/lm_eval/models/hf_audiolm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,845 copying build/lib/lm_eval/models/gguf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,847 copying build/lib/lm_eval/models/onnxruntime_genai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,850 copying build/lib/lm_eval/models/optimum_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,852 copying build/lib/lm_eval/models/api_models.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,855 copying build/lib/lm_eval/models/onnxruntime_ort.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,858 copying build/lib/lm_eval/models/litellm_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,861 copying build/lib/lm_eval/models/vllm_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,864 copying build/lib/lm_eval/models/hf_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,867 copying build/lib/lm_eval/models/megatron_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,871 copying build/lib/lm_eval/models/sglang_generate_API.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,873 copying build/lib/lm_eval/models/mamba_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,876 copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,878 copying build/lib/lm_eval/models/mistral3.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,880 copying build/lib/lm_eval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,883 copying build/lib/lm_eval/models/sglang_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,886 copying build/lib/lm_eval/models/optimum_ipex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,888 copying build/lib/lm_eval/models/utils_hf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,891 copying build/lib/lm_eval/models/anthropic_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,893 copying build/lib/lm_eval/models/neuron_optimum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,896 copying build/lib/lm_eval/models/winml.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,898 copying build/lib/lm_eval/models/vllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,901 copying build/lib/lm_eval/models/_onnx_base.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,903 copying build/lib/lm_eval/models/openai_completions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,905 copying build/lib/lm_eval/models/optimum_habana.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,908 copying build/lib/lm_eval/models/huggingface.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,911 copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,913 copying build/lib/lm_eval/models/hf_steered.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,915 copying build/lib/lm_eval/models/ibm_watsonx_ai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2026-09-01T00:16:19,918 creating build/bdist.linux-armv7l/wheel/lm_eval/prompts 2026-09-01T00:16:19,919 copying build/lib/lm_eval/prompts/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/prompts 2026-09-01T00:16:19,922 creating build/bdist.linux-armv7l/wheel/lm_eval/loggers 2026-09-01T00:16:19,923 copying build/lib/lm_eval/loggers/trackio_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:16:19,925 copying build/lib/lm_eval/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:16:19,927 copying build/lib/lm_eval/loggers/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:16:19,929 copying build/lib/lm_eval/loggers/wandb_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:16:19,932 copying build/lib/lm_eval/loggers/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2026-09-01T00:16:19,934 copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:19,936 copying build/lib/lm_eval/evaluator_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:19,943 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks 2026-09-01T00:16:19,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,946 copying build/lib/lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,949 copying build/lib/lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,951 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,952 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,954 copying build/lib/lm_eval/tasks/hendrycks_ethics/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,956 copying build/lib/lm_eval/tasks/hendrycks_ethics/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,958 copying build/lib/lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,960 copying build/lib/lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2026-09-01T00:16:19,962 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench 2026-09-01T00:16:19,964 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,965 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,968 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,970 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,973 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,975 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,977 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,979 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,981 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,983 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,985 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,987 copying build/lib/lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot_with_pddl 2026-09-01T00:16:19,990 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:19,991 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:19,993 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:19,995 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:19,997 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:19,999 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:20,001 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:20,003 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:20,004 copying build/lib/lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/boolq_cot_2shot 2026-09-01T00:16:20,006 copying build/lib/lm_eval/tasks/acpbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench 2026-09-01T00:16:20,009 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,010 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,012 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,014 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,017 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,019 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,021 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/next_act.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,023 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,025 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,027 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,029 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,031 copying build/lib/lm_eval/tasks/acpbench/gen_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/gen_2shot 2026-09-01T00:16:20,033 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,035 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,037 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,039 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,041 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,042 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,045 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,047 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,049 copying build/lib/lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/acpbench/mcq_cot_2shot 2026-09-01T00:16:20,051 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mbpp 2026-09-01T00:16:20,052 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:16:20,054 copying build/lib/lm_eval/tasks/mbpp/mbpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:16:20,056 copying build/lib/lm_eval/tasks/mbpp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:16:20,058 copying build/lib/lm_eval/tasks/mbpp/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:16:20,060 copying build/lib/lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:16:20,062 copying build/lib/lm_eval/tasks/mbpp/mbpp_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mbpp 2026-09-01T00:16:20,064 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa 2026-09-01T00:16:20,066 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:16:20,068 copying build/lib/lm_eval/tasks/truthfulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:16:20,070 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:16:20,072 copying build/lib/lm_eval/tasks/truthfulqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:16:20,074 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2026-09-01T00:16:20,076 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/siqa 2026-09-01T00:16:20,077 copying build/lib/lm_eval/tasks/siqa/siqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2026-09-01T00:16:20,079 copying build/lib/lm_eval/tasks/siqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2026-09-01T00:16:20,082 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/c4 2026-09-01T00:16:20,083 copying build/lib/lm_eval/tasks/c4/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-09-01T00:16:20,085 copying build/lib/lm_eval/tasks/c4/preprocess_c4.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-09-01T00:16:20,087 copying build/lib/lm_eval/tasks/c4/c4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/c4 2026-09-01T00:16:20,089 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux 2026-09-01T00:16:20,092 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,093 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,095 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,097 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,098 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,100 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,102 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,104 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,106 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,108 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,109 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,111 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,113 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,115 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,117 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,119 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,121 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,123 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,125 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,127 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,128 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,130 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,132 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,134 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,136 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,138 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,140 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,142 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,144 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,145 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,147 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,149 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,151 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,153 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,155 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,156 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,158 copying build/lib/lm_eval/tasks/mmlu-redux/generative/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,160 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,162 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,164 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,166 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,168 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,169 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,171 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,173 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,175 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,177 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,178 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,180 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,182 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,184 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,186 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,188 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,190 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,192 copying build/lib/lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,193 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,195 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,197 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,199 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,201 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,202 copying build/lib/lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux/generative 2026-09-01T00:16:20,205 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:16:20,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:16:20,208 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:16:20,210 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:16:20,211 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2026-09-01T00:16:20,214 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:16:20,215 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:16:20,217 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:16:20,218 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2026-09-01T00:16:20,221 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:16:20,222 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:16:20,224 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:16:20,225 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2026-09-01T00:16:20,228 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:16:20,229 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:16:20,231 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:16:20,233 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2026-09-01T00:16:20,235 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,237 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,238 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,240 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,242 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,244 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,246 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,248 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,249 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,251 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,253 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,255 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2026-09-01T00:16:20,257 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:16:20,258 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:16:20,260 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:16:20,262 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2026-09-01T00:16:20,264 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:16:20,266 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:16:20,268 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:16:20,269 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2026-09-01T00:16:20,273 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,274 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,276 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,278 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,280 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,282 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,283 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,285 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,287 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,289 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,291 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,293 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,294 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,296 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,298 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,300 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,302 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,304 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,306 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,307 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,309 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,311 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,313 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,315 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,317 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,319 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,321 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,323 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,325 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,327 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,329 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,331 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,332 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,334 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,336 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,338 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,340 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,342 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,344 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,346 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,348 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,350 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,352 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,353 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,355 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,357 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,359 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,361 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,362 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,364 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,366 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,368 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,370 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,372 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,374 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,375 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,377 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,379 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,381 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,383 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2026-09-01T00:16:20,385 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:16:20,386 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:16:20,388 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:16:20,390 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2026-09-01T00:16:20,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,395 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,397 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,399 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,401 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,403 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,405 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,407 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,409 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,410 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,412 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,414 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,416 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,418 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,420 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,422 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,424 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,425 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,427 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,429 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,431 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,433 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,435 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,437 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,439 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,441 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,442 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,444 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,446 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,448 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,450 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,452 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,453 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,455 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,457 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,459 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,461 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,463 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,465 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,466 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,468 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,470 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,472 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,474 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,476 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,478 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,479 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,481 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,483 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,485 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,487 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,489 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,491 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,493 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,495 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,498 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,500 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,502 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,505 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,507 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,509 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2026-09-01T00:16:20,512 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:16:20,515 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:16:20,517 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:16:20,519 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:16:20,521 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2026-09-01T00:16:20,524 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:16:20,526 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:16:20,528 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:16:20,531 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2026-09-01T00:16:20,533 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2026-09-01T00:16:20,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:16:20,537 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:16:20,540 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:16:20,542 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2026-09-01T00:16:20,545 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:16:20,547 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:16:20,549 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:16:20,551 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2026-09-01T00:16:20,554 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:16:20,556 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:16:20,558 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:16:20,560 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2026-09-01T00:16:20,565 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,566 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,569 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,571 copying build/lib/lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,573 copying build/lib/lm_eval/tasks/blimp_nl/r_words__adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,576 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,578 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,580 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,583 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,585 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,587 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,590 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,592 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,594 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,596 copying build/lib/lm_eval/tasks/blimp_nl/passive__impersonal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,598 copying build/lib/lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,600 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,602 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,604 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,605 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,607 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,609 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,611 copying build/lib/lm_eval/tasks/blimp_nl/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,613 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,614 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,617 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,618 copying build/lib/lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,620 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,622 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,624 copying build/lib/lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,626 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,628 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,629 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,631 copying build/lib/lm_eval/tasks/blimp_nl/complementive__position_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,633 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,635 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,637 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,639 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,641 copying build/lib/lm_eval/tasks/blimp_nl/complementive__transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,643 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,645 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,646 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,648 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,650 copying build/lib/lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,652 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,654 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,656 copying build/lib/lm_eval/tasks/blimp_nl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,658 copying build/lib/lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,660 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,662 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,664 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,665 copying build/lib/lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,667 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,669 copying build/lib/lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,671 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,673 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,675 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,677 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,678 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,680 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,682 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,684 copying build/lib/lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,686 copying build/lib/lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,688 copying build/lib/lm_eval/tasks/blimp_nl/passive__aci.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,690 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,692 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,694 copying build/lib/lm_eval/tasks/blimp_nl/relativization__island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,696 copying build/lib/lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,698 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,700 copying build/lib/lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,701 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,703 copying build/lib/lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,705 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,707 copying build/lib/lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,709 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,711 copying build/lib/lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,713 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,715 copying build/lib/lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,716 copying build/lib/lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,718 copying build/lib/lm_eval/tasks/blimp_nl/verb_second__order_main.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,720 copying build/lib/lm_eval/tasks/blimp_nl/complementive__intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,722 copying build/lib/lm_eval/tasks/blimp_nl/blimp_nl_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,724 copying build/lib/lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,726 copying build/lib/lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,728 copying build/lib/lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,730 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,732 copying build/lib/lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,734 copying build/lib/lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp_nl 2026-09-01T00:16:20,736 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ulqa 2026-09-01T00:16:20,737 copying build/lib/lm_eval/tasks/ulqa/lambada_uyghur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,739 copying build/lib/lm_eval/tasks/ulqa/celep1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,742 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,743 copying build/lib/lm_eval/tasks/ulqa/ulut/wag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,745 copying build/lib/lm_eval/tasks/ulqa/ulut/nug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,747 copying build/lib/lm_eval/tasks/ulqa/ulut/ulut.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,749 copying build/lib/lm_eval/tasks/ulqa/ulut/wub.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,751 copying build/lib/lm_eval/tasks/ulqa/ulut/wum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,752 copying build/lib/lm_eval/tasks/ulqa/ulut/wsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa/ulut 2026-09-01T00:16:20,754 copying build/lib/lm_eval/tasks/ulqa/ulqa_.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,756 copying build/lib/lm_eval/tasks/ulqa/uleval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,758 copying build/lib/lm_eval/tasks/ulqa/celep2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,760 copying build/lib/lm_eval/tasks/ulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,762 copying build/lib/lm_eval/tasks/ulqa/ulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ulqa 2026-09-01T00:16:20,764 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lingoly 2026-09-01T00:16:20,766 copying build/lib/lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:16:20,768 copying build/lib/lm_eval/tasks/lingoly/lingoly_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:16:20,769 copying build/lib/lm_eval/tasks/lingoly/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:16:20,771 copying build/lib/lm_eval/tasks/lingoly/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:16:20,773 copying build/lib/lm_eval/tasks/lingoly/script.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:16:20,775 copying build/lib/lm_eval/tasks/lingoly/lingoly_context.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2026-09-01T00:16:20,778 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,779 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,781 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,783 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,785 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,786 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,788 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,790 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,792 copying build/lib/lm_eval/tasks/mmlu-pro-plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,794 copying build/lib/lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,796 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,798 copying build/lib/lm_eval/tasks/mmlu-pro-plus/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,800 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,802 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,803 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,805 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,807 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,809 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,811 copying build/lib/lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-pro-plus 2026-09-01T00:16:20,813 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mimic_repsum 2026-09-01T00:16:20,814 copying build/lib/lm_eval/tasks/mimic_repsum/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:16:20,816 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:16:20,818 copying build/lib/lm_eval/tasks/mimic_repsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:16:20,820 copying build/lib/lm_eval/tasks/mimic_repsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:16:20,822 copying build/lib/lm_eval/tasks/mimic_repsum/mimic_repsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mimic_repsum 2026-09-01T00:16:20,826 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egymmlu 2026-09-01T00:16:20,827 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,829 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,831 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,833 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,834 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,836 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,838 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,840 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,842 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,844 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,846 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,848 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,850 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,852 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,854 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,856 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,857 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,859 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,861 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,863 copying build/lib/lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,865 copying build/lib/lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,867 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,869 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,871 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,872 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,874 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,876 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,878 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,880 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,882 copying build/lib/lm_eval/tasks/egymmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,884 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,886 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,888 copying build/lib/lm_eval/tasks/egymmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,890 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,892 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,894 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,895 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,897 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,899 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,902 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,903 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,905 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,907 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,909 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,911 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,913 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,915 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,916 copying build/lib/lm_eval/tasks/egymmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,918 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,920 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,922 copying build/lib/lm_eval/tasks/egymmlu/egymmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egymmlu 2026-09-01T00:16:20,925 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aime 2026-09-01T00:16:20,926 copying build/lib/lm_eval/tasks/aime/aime25.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:16:20,928 copying build/lib/lm_eval/tasks/aime/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:16:20,930 copying build/lib/lm_eval/tasks/aime/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:16:20,932 copying build/lib/lm_eval/tasks/aime/aime24.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:16:20,934 copying build/lib/lm_eval/tasks/aime/aime.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aime 2026-09-01T00:16:20,937 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/icelandic_winogrande 2026-09-01T00:16:20,938 copying build/lib/lm_eval/tasks/icelandic_winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-09-01T00:16:20,940 copying build/lib/lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-09-01T00:16:20,942 copying build/lib/lm_eval/tasks/icelandic_winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/icelandic_winogrande 2026-09-01T00:16:20,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmt2016 2026-09-01T00:16:20,945 copying build/lib/lm_eval/tasks/wmt2016/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-09-01T00:16:20,948 copying build/lib/lm_eval/tasks/wmt2016/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-09-01T00:16:20,950 copying build/lib/lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2026-09-01T00:16:20,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xcopa 2026-09-01T00:16:20,953 copying build/lib/lm_eval/tasks/xcopa/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,956 copying build/lib/lm_eval/tasks/xcopa/default_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,958 copying build/lib/lm_eval/tasks/xcopa/default_et.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,959 copying build/lib/lm_eval/tasks/xcopa/default_ht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,961 copying build/lib/lm_eval/tasks/xcopa/default_qu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,963 copying build/lib/lm_eval/tasks/xcopa/default_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,965 copying build/lib/lm_eval/tasks/xcopa/default_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,966 copying build/lib/lm_eval/tasks/xcopa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,968 copying build/lib/lm_eval/tasks/xcopa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,970 copying build/lib/lm_eval/tasks/xcopa/_xcopa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,972 copying build/lib/lm_eval/tasks/xcopa/default_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,974 copying build/lib/lm_eval/tasks/xcopa/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,976 copying build/lib/lm_eval/tasks/xcopa/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,977 copying build/lib/lm_eval/tasks/xcopa/default_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2026-09-01T00:16:20,981 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_exams 2026-09-01T00:16:20,982 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,984 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,986 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,988 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,990 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,991 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,993 copying build/lib/lm_eval/tasks/eus_exams/eus_exams -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,995 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,997 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:20,999 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,001 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,003 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,005 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,007 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,009 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,011 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,013 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,015 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,016 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,018 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,020 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,022 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,023 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,025 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,027 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,029 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,031 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,033 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,035 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,037 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,038 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,040 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,042 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,044 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,046 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,048 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,050 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,052 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,054 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,056 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,058 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,060 copying build/lib/lm_eval/tasks/eus_exams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,062 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,064 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,066 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,067 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,069 copying build/lib/lm_eval/tasks/eus_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,071 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,073 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,075 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,077 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,078 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,080 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,082 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,084 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,086 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,088 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,090 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,091 copying build/lib/lm_eval/tasks/eus_exams/configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,093 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,096 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,097 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,099 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,101 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,103 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,105 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,107 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,109 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2026-09-01T00:16:21,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cruxeval 2026-09-01T00:16:21,113 copying build/lib/lm_eval/tasks/cruxeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,115 copying build/lib/lm_eval/tasks/cruxeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,118 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_input_08.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,120 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,122 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_output.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,124 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_input.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,126 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_output_08.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,128 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_input_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,129 copying build/lib/lm_eval/tasks/cruxeval/cruxeval_output_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cruxeval 2026-09-01T00:16:21,132 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/translation 2026-09-01T00:16:21,133 copying build/lib/lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,135 copying build/lib/lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,137 copying build/lib/lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,139 copying build/lib/lm_eval/tasks/translation/wmt16_de-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,141 copying build/lib/lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,142 copying build/lib/lm_eval/tasks/translation/wmt16_en-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,144 copying build/lib/lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,146 copying build/lib/lm_eval/tasks/translation/wmt_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,148 copying build/lib/lm_eval/tasks/translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,151 copying build/lib/lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,154 copying build/lib/lm_eval/tasks/translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2026-09-01T00:16:21,157 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench 2026-09-01T00:16:21,158 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,160 copying build/lib/lm_eval/tasks/galician_bench/galician_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,161 copying build/lib/lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,163 copying build/lib/lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,166 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,167 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,168 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,170 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,172 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,173 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,175 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,177 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,179 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,180 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,182 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,185 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,186 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,188 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,190 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,192 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,193 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,195 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,197 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,199 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2026-09-01T00:16:21,200 copying build/lib/lm_eval/tasks/galician_bench/galcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,202 copying build/lib/lm_eval/tasks/galician_bench/paws_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,204 copying build/lib/lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,206 copying build/lib/lm_eval/tasks/galician_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,208 copying build/lib/lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,210 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,211 copying build/lib/lm_eval/tasks/galician_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,213 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,215 copying build/lib/lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,217 copying build/lib/lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,218 copying build/lib/lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2026-09-01T00:16:21,221 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,222 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_history_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,224 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,226 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_driving_rules.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,228 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,229 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_history_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,231 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_agriculture_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,233 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,234 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_economics_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,236 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,238 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,239 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,241 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,243 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_maritime_safety_and_rescue_operations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,244 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,246 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_physics_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,248 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,250 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_management_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,252 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,253 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_traditions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,255 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_education_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,257 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,258 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_geography_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,260 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,261 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_art_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,263 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,265 copying build/lib/lm_eval/tasks/greekmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,266 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_computer_networks_and_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,268 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_medicine_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,270 copying build/lib/lm_eval/tasks/greekmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,272 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_physics_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,273 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_agriculture_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,275 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_computer_science_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,277 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_mythology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,278 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,280 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,282 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_medicine_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,284 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,285 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,287 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_art_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,289 copying build/lib/lm_eval/tasks/greekmmlu/_default_greekmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,291 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,293 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,295 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_greek_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,297 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_physics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,299 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,300 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,302 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_education_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,304 copying build/lib/lm_eval/tasks/greekmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,306 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_secondary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,308 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,309 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,311 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_art_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,313 copying build/lib/lm_eval/tasks/greekmmlu/_greekmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,314 copying build/lib/lm_eval/tasks/greekmmlu/greekmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/greekmmlu 2026-09-01T00:16:21,317 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:21,318 copying build/lib/lm_eval/tasks/openai-mmmlu/languages.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:21,320 copying build/lib/lm_eval/tasks/openai-mmmlu/subjects.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:21,322 copying build/lib/lm_eval/tasks/openai-mmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:21,324 copying build/lib/lm_eval/tasks/openai-mmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu 2026-09-01T00:16:21,339 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,340 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,342 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,344 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,346 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,347 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,349 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,351 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,353 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,355 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,357 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,358 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,360 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,362 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,364 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,365 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,367 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,369 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,371 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,373 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,375 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,377 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,378 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,380 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,382 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,384 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,386 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,388 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,390 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,392 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,394 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,396 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,397 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,399 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,401 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,403 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,405 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,406 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,408 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,410 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,412 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,414 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,416 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,418 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,420 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,421 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,423 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,425 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,427 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,429 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,431 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,433 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,435 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,437 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,439 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,441 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,443 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,444 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,446 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,448 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,450 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,451 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,453 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,455 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,456 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,458 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,460 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,462 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,464 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,465 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,467 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,469 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,471 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,473 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,475 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,477 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,479 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,481 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,482 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,484 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,486 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,488 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,490 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,492 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,493 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,495 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,497 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,499 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,501 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,503 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,505 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,507 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,509 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,511 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,513 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,514 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,516 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,518 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,520 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,522 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,525 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,526 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,528 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,530 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,532 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,534 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,536 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,538 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,539 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,541 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,543 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,545 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,547 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,549 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,551 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,553 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,555 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,557 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,559 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,560 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,562 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,564 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,567 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,569 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,570 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,572 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,574 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,576 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,577 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,579 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,581 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,583 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,584 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,586 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,588 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,590 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,592 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,594 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,596 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,598 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,599 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,601 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,603 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,605 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,607 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,609 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,610 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,612 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,614 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,616 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,618 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,619 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,621 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,623 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,625 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,627 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,628 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,630 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,632 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,634 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,636 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,638 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,640 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,641 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,643 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,645 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,647 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,649 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,650 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,652 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,654 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,656 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,658 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,659 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,661 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,663 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,665 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,667 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,669 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,670 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,672 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,674 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,676 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,678 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,680 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,681 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,683 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,685 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,687 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,689 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,691 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,693 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,694 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,696 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,698 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,700 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,702 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,703 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,705 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,707 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,709 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,710 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,712 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,714 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,716 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,718 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,720 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,721 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,723 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,725 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,727 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,729 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,731 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,732 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,734 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,736 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,738 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,739 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,741 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,743 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,745 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,746 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,748 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,750 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,752 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,754 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,756 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,757 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,759 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,761 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,763 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,765 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,767 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,769 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,771 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,772 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,774 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,776 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,778 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,780 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,782 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,784 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,786 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,787 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,789 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,791 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,792 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,794 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,796 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,798 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,799 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,801 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,803 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,804 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,806 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,808 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,809 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,811 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,812 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,814 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,816 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,817 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,819 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,820 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,822 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,824 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,826 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,827 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,829 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,831 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,832 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,834 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,836 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,838 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,839 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,841 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,843 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,845 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,846 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,848 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,850 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,851 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,853 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,855 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,856 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,858 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,860 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,862 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,864 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,866 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,868 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,869 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,871 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,873 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,875 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,876 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,878 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,880 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,882 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,884 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,885 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,887 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,889 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,891 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,893 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,895 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,897 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,898 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,900 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,902 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,904 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,906 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,908 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,910 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,911 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,913 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,915 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,917 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,918 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,920 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,922 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,924 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,926 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,928 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,929 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,931 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,933 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,934 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,936 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,938 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,940 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,941 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,943 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,945 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,947 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,949 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,951 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,953 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,955 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,956 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,958 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,960 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,962 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,964 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,966 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,968 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,969 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,971 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,973 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,975 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,977 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,979 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,980 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,982 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,984 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,986 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,988 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,990 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,991 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,993 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,995 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,997 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:21,999 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,001 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,002 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,004 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,006 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,008 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,010 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,012 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,014 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,016 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,017 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,019 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,021 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,023 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,025 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,027 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,029 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,030 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,032 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,034 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,036 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,038 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,040 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,042 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,044 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,046 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,048 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,049 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,051 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,053 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,055 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,057 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,059 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,061 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,063 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,065 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,066 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,068 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,070 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,072 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,074 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,076 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,078 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,080 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,082 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,083 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,085 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,087 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,089 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,091 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,093 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,095 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,096 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,098 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,100 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,102 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,104 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,106 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,108 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,110 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,112 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,114 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,116 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,118 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,119 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,121 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,123 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,125 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,127 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,129 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,131 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,133 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,135 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,137 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,138 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,140 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,142 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,144 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,146 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,147 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,149 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,151 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,153 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,155 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,157 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,159 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,160 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,162 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,164 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,166 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,168 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,170 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,171 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,174 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,175 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,177 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,179 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,181 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,183 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,184 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,187 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,188 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,190 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,192 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,194 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,196 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,198 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,200 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,202 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,204 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,206 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,207 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,209 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,211 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,213 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,215 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,217 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,219 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,221 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,223 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,225 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,227 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,229 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,230 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,232 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,234 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,236 copying build/lib/lm_eval/tasks/openai-mmmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,238 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,240 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,242 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,244 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,246 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,247 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,249 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,251 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,253 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,255 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,257 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,259 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,261 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,263 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,265 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,267 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,269 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,271 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,272 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,274 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,276 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,278 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,280 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,282 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,283 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,285 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,287 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,289 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,291 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,293 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,298 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,300 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,302 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,304 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,306 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,307 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,309 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,311 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,313 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,315 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,317 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,319 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,320 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,322 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,324 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,326 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,328 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,330 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,332 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,334 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,336 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,338 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,340 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,342 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,344 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,346 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,348 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,349 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,351 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,353 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,355 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,357 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,358 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,360 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,362 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,364 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,366 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,368 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,370 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,371 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,373 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,376 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,378 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,380 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,382 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,383 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,385 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,387 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,389 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,391 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,393 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,395 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,397 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,398 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,400 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,402 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,404 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,406 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,408 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,409 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,411 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,413 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,415 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,417 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,419 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,420 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,422 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,424 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,426 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,428 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,430 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,431 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,433 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,435 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,437 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,439 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,441 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,443 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,445 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,447 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,449 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,451 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,453 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,455 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,457 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,459 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,461 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,464 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,466 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,468 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,470 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,472 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,474 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,476 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,478 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,479 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,481 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,483 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,485 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,487 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,489 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,491 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,493 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,495 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,497 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,499 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,501 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,503 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,506 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,508 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,510 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,512 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,514 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,516 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,518 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,520 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,522 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,524 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,526 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,528 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,530 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,532 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,534 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,536 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,538 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,540 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,542 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,544 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,546 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,549 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,551 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,553 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,555 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,557 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,559 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,561 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,563 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,565 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,567 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,569 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,571 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,573 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,575 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,577 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,579 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,581 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,583 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,585 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,587 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,589 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,591 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,594 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,596 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,598 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,600 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,602 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,604 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,606 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,608 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,610 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,612 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,614 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,616 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,618 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,620 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,622 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,624 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,626 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,628 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,630 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,632 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,634 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,637 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,639 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,641 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,643 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,645 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,647 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,649 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,652 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,654 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,656 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,658 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,660 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,662 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,664 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,666 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,668 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,670 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,672 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,674 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,676 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,678 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,680 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,682 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,684 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,687 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,689 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,691 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,693 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,696 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,698 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,700 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,702 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,704 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,706 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,708 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,710 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,713 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,715 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,717 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,719 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,721 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,723 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,725 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,727 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,729 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,731 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,734 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,736 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,738 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,740 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,742 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,744 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,746 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,748 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,750 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,752 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,754 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,757 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,759 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,761 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,763 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,765 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,767 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,769 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,771 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,773 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,775 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,778 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,780 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,782 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,784 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,786 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,788 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,790 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,792 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,794 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,797 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,798 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,800 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,802 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,804 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,806 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,808 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,810 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,812 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,814 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,816 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,818 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,821 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,823 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,825 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,827 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,829 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,831 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,833 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,835 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,837 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,840 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,842 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,844 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,846 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,847 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,849 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,851 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,853 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,856 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,858 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,860 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,862 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,864 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,866 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,868 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,870 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,872 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,874 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,876 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,878 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,880 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,882 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,884 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,887 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,889 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,891 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,892 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,894 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,897 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,899 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,900 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,902 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,904 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,906 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,908 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,910 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,912 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,914 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,916 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,919 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,921 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,923 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,925 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,927 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,929 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,931 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,933 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,935 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,937 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,939 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,941 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,944 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,946 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,948 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,950 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,952 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,954 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,956 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,958 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,960 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,962 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,964 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,966 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,968 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,970 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,972 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,974 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,977 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,979 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,981 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,982 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,984 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,987 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,989 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,991 copying build/lib/lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,993 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,995 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,997 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:22,999 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:23,001 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:23,003 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:23,005 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:23,007 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:23,009 copying build/lib/lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openai-mmmlu/default 2026-09-01T00:16:23,012 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ruler 2026-09-01T00:16:23,014 copying build/lib/lm_eval/tasks/ruler/vt_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,016 copying build/lib/lm_eval/tasks/ruler/niah_single_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,018 copying build/lib/lm_eval/tasks/ruler/prepare_niah.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,021 copying build/lib/lm_eval/tasks/ruler/essays.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,023 copying build/lib/lm_eval/tasks/ruler/niah_multivalue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,025 copying build/lib/lm_eval/tasks/ruler/cwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,027 copying build/lib/lm_eval/tasks/ruler/niah_multikey_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,029 copying build/lib/lm_eval/tasks/ruler/vt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,031 copying build/lib/lm_eval/tasks/ruler/qa_squad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,032 copying build/lib/lm_eval/tasks/ruler/qa_hotpot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,034 copying build/lib/lm_eval/tasks/ruler/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,037 copying build/lib/lm_eval/tasks/ruler/niah_multikey_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,039 copying build/lib/lm_eval/tasks/ruler/fwe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,041 copying build/lib/lm_eval/tasks/ruler/niah_multikey_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,043 copying build/lib/lm_eval/tasks/ruler/qa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,046 copying build/lib/lm_eval/tasks/ruler/cwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,048 copying build/lib/lm_eval/tasks/ruler/niah_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,050 copying build/lib/lm_eval/tasks/ruler/niah_single_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,052 copying build/lib/lm_eval/tasks/ruler/niah_multiquery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,054 copying build/lib/lm_eval/tasks/ruler/ruler.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,056 copying build/lib/lm_eval/tasks/ruler/niah_single_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,058 copying build/lib/lm_eval/tasks/ruler/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,060 copying build/lib/lm_eval/tasks/ruler/fwe_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ruler 2026-09-01T00:16:23,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openbookqa 2026-09-01T00:16:23,064 copying build/lib/lm_eval/tasks/openbookqa/openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2026-09-01T00:16:23,066 copying build/lib/lm_eval/tasks/openbookqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2026-09-01T00:16:23,069 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turblimp 2026-09-01T00:16:23,070 copying build/lib/lm_eval/tasks/turblimp/island_effects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,072 copying build/lib/lm_eval/tasks/turblimp/binding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,073 copying build/lib/lm_eval/tasks/turblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,075 copying build/lib/lm_eval/tasks/turblimp/passives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,077 copying build/lib/lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,079 copying build/lib/lm_eval/tasks/turblimp/nominalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,081 copying build/lib/lm_eval/tasks/turblimp/npi_licensing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,083 copying build/lib/lm_eval/tasks/turblimp/subject_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,085 copying build/lib/lm_eval/tasks/turblimp/relative_clauses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,086 copying build/lib/lm_eval/tasks/turblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,088 copying build/lib/lm_eval/tasks/turblimp/scrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,090 copying build/lib/lm_eval/tasks/turblimp/ellipsis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,092 copying build/lib/lm_eval/tasks/turblimp/suspended_affixation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,094 copying build/lib/lm_eval/tasks/turblimp/anaphor_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,096 copying build/lib/lm_eval/tasks/turblimp/argument_structure_transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,097 copying build/lib/lm_eval/tasks/turblimp/quantifiers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,099 copying build/lib/lm_eval/tasks/turblimp/irregular_forms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,101 copying build/lib/lm_eval/tasks/turblimp/turblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,103 copying build/lib/lm_eval/tasks/turblimp/determiners.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turblimp 2026-09-01T00:16:23,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cabbq 2026-09-01T00:16:23,106 copying build/lib/lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,108 copying build/lib/lm_eval/tasks/cabbq/cabbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,110 copying build/lib/lm_eval/tasks/cabbq/cabbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,112 copying build/lib/lm_eval/tasks/cabbq/cabbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,113 copying build/lib/lm_eval/tasks/cabbq/cabbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,115 copying build/lib/lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,117 copying build/lib/lm_eval/tasks/cabbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,119 copying build/lib/lm_eval/tasks/cabbq/cabbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,121 copying build/lib/lm_eval/tasks/cabbq/_cabbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,123 copying build/lib/lm_eval/tasks/cabbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,125 copying build/lib/lm_eval/tasks/cabbq/cabbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,127 copying build/lib/lm_eval/tasks/cabbq/cabbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,129 copying build/lib/lm_eval/tasks/cabbq/cabbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,131 copying build/lib/lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cabbq 2026-09-01T00:16:23,133 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu 2026-09-01T00:16:23,134 copying build/lib/lm_eval/tasks/tmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2026-09-01T00:16:23,137 copying build/lib/lm_eval/tasks/tmlu/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2026-09-01T00:16:23,140 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,141 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,143 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,145 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,147 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,149 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,150 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,152 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,154 copying build/lib/lm_eval/tasks/tmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,156 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,158 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,159 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,161 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,163 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,165 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,167 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,169 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,170 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,172 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,174 copying build/lib/lm_eval/tasks/tmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,176 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,178 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,180 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,182 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,184 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,186 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,187 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,189 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,191 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,193 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,195 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,196 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,198 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,200 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,201 copying build/lib/lm_eval/tasks/tmlu/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,204 copying build/lib/lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2026-09-01T00:16:23,206 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench 2026-09-01T00:16:23,207 copying build/lib/lm_eval/tasks/eq_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-09-01T00:16:23,209 copying build/lib/lm_eval/tasks/eq_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-09-01T00:16:23,211 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:16:23,212 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:16:23,215 copying build/lib/lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:16:23,216 copying build/lib/lm_eval/tasks/eq_bench/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench/multilingual 2026-09-01T00:16:23,218 copying build/lib/lm_eval/tasks/eq_bench/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2026-09-01T00:16:23,221 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,222 copying build/lib/lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,225 copying build/lib/lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,227 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,229 copying build/lib/lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,231 copying build/lib/lm_eval/tasks/catalan_bench/cocoteros_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,233 copying build/lib/lm_eval/tasks/catalan_bench/teca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,235 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,237 copying build/lib/lm_eval/tasks/catalan_bench/catcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,238 copying build/lib/lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,240 copying build/lib/lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,242 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,244 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,246 copying build/lib/lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,248 copying build/lib/lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,250 copying build/lib/lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,251 copying build/lib/lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,253 copying build/lib/lm_eval/tasks/catalan_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,256 copying build/lib/lm_eval/tasks/catalan_bench/coqcat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,258 copying build/lib/lm_eval/tasks/catalan_bench/xnli_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,259 copying build/lib/lm_eval/tasks/catalan_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,262 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:16:23,263 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/cieacova.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:16:23,265 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:16:23,268 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/cieacova_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:16:23,270 copying build/lib/lm_eval/tasks/catalan_bench/cieacova/cieacova_word.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/cieacova 2026-09-01T00:16:23,272 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:16:23,273 copying build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:16:23,275 copying build/lib/lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/truthfulqa_va 2026-09-01T00:16:23,278 copying build/lib/lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,280 copying build/lib/lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,282 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,283 copying build/lib/lm_eval/tasks/catalan_bench/terretaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,285 copying build/lib/lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,288 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,289 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,292 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,294 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,296 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,298 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,300 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,302 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,304 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,305 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,307 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,309 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,311 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,313 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,315 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,316 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,318 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,320 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,322 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,324 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2026-09-01T00:16:23,326 copying build/lib/lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,328 copying build/lib/lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,330 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:16:23,331 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:16:23,333 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:16:23,335 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2026-09-01T00:16:23,337 copying build/lib/lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2026-09-01T00:16:23,340 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babilong 2026-09-01T00:16:23,341 copying build/lib/lm_eval/tasks/babilong/babilong.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,343 copying build/lib/lm_eval/tasks/babilong/babilong_qa11.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,345 copying build/lib/lm_eval/tasks/babilong/babilong_qa7.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,347 copying build/lib/lm_eval/tasks/babilong/babilong_qa16.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,349 copying build/lib/lm_eval/tasks/babilong/babilong_qa15.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,351 copying build/lib/lm_eval/tasks/babilong/babilong_longctx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,353 copying build/lib/lm_eval/tasks/babilong/babilong_qa13.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,355 copying build/lib/lm_eval/tasks/babilong/babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,357 copying build/lib/lm_eval/tasks/babilong/babilong_qa12.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,359 copying build/lib/lm_eval/tasks/babilong/babilong_qa20.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,361 copying build/lib/lm_eval/tasks/babilong/babilong_qa8.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,363 copying build/lib/lm_eval/tasks/babilong/babilong_qa19.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,365 copying build/lib/lm_eval/tasks/babilong/babilong_qa10.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,367 copying build/lib/lm_eval/tasks/babilong/babilong_qa18.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,369 copying build/lib/lm_eval/tasks/babilong/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,371 copying build/lib/lm_eval/tasks/babilong/babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,373 copying build/lib/lm_eval/tasks/babilong/babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,375 copying build/lib/lm_eval/tasks/babilong/babilong_qa6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,377 copying build/lib/lm_eval/tasks/babilong/babilong_qa9.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,379 copying build/lib/lm_eval/tasks/babilong/babilong_qa17.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,381 copying build/lib/lm_eval/tasks/babilong/babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,383 copying build/lib/lm_eval/tasks/babilong/common_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,385 copying build/lib/lm_eval/tasks/babilong/babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,387 copying build/lib/lm_eval/tasks/babilong/_babilong_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,389 copying build/lib/lm_eval/tasks/babilong/babilong_qa14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babilong 2026-09-01T00:16:23,391 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,392 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,394 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,396 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,398 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,400 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,402 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,403 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,405 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2026-09-01T00:16:23,408 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/csatqa 2026-09-01T00:16:23,409 copying build/lib/lm_eval/tasks/csatqa/_csatqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,410 copying build/lib/lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,412 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,414 copying build/lib/lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,417 copying build/lib/lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,420 copying build/lib/lm_eval/tasks/csatqa/csatqa_li.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,422 copying build/lib/lm_eval/tasks/csatqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,424 copying build/lib/lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,426 copying build/lib/lm_eval/tasks/csatqa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,428 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2026-09-01T00:16:23,431 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm 2026-09-01T00:16:23,433 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,434 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,437 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,439 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,441 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,443 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,446 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,448 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,451 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,453 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,455 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,458 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,460 copying build/lib/lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2026-09-01T00:16:23,462 copying build/lib/lm_eval/tasks/mgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-09-01T00:16:23,464 copying build/lib/lm_eval/tasks/mgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-09-01T00:16:23,467 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,468 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,471 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,473 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,475 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,477 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,479 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,481 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,484 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,486 copying build/lib/lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,488 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,490 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,493 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2026-09-01T00:16:23,496 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,497 copying build/lib/lm_eval/tasks/mgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,500 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,502 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,504 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,506 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,508 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,510 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,512 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,515 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,517 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,518 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,520 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2026-09-01T00:16:23,521 copying build/lib/lm_eval/tasks/mgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2026-09-01T00:16:23,524 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meddialog 2026-09-01T00:16:23,525 copying build/lib/lm_eval/tasks/meddialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,527 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,528 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,530 copying build/lib/lm_eval/tasks/meddialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,532 copying build/lib/lm_eval/tasks/meddialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,534 copying build/lib/lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,535 copying build/lib/lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meddialog 2026-09-01T00:16:23,539 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/belebele 2026-09-01T00:16:23,541 copying build/lib/lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,542 copying build/lib/lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,544 copying build/lib/lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,546 copying build/lib/lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,548 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,550 copying build/lib/lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,551 copying build/lib/lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,553 copying build/lib/lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,555 copying build/lib/lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,557 copying build/lib/lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,558 copying build/lib/lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,560 copying build/lib/lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,562 copying build/lib/lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,564 copying build/lib/lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,566 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,567 copying build/lib/lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,569 copying build/lib/lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,571 copying build/lib/lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,573 copying build/lib/lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,574 copying build/lib/lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,576 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,578 copying build/lib/lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,580 copying build/lib/lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,581 copying build/lib/lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,583 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,585 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,587 copying build/lib/lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,589 copying build/lib/lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,590 copying build/lib/lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,592 copying build/lib/lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,594 copying build/lib/lm_eval/tasks/belebele/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,596 copying build/lib/lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,598 copying build/lib/lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,599 copying build/lib/lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,601 copying build/lib/lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,603 copying build/lib/lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,605 copying build/lib/lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,607 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,608 copying build/lib/lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,610 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,612 copying build/lib/lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,614 copying build/lib/lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,616 copying build/lib/lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,618 copying build/lib/lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,619 copying build/lib/lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,621 copying build/lib/lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,623 copying build/lib/lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,625 copying build/lib/lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,626 copying build/lib/lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,628 copying build/lib/lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,630 copying build/lib/lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,632 copying build/lib/lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,633 copying build/lib/lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,635 copying build/lib/lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,637 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,639 copying build/lib/lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,640 copying build/lib/lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,642 copying build/lib/lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,644 copying build/lib/lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,646 copying build/lib/lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,648 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,649 copying build/lib/lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,651 copying build/lib/lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,653 copying build/lib/lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,655 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,657 copying build/lib/lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,658 copying build/lib/lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,660 copying build/lib/lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,662 copying build/lib/lm_eval/tasks/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,664 copying build/lib/lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,666 copying build/lib/lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,668 copying build/lib/lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,669 copying build/lib/lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,671 copying build/lib/lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,673 copying build/lib/lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,674 copying build/lib/lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,676 copying build/lib/lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,678 copying build/lib/lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,680 copying build/lib/lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,681 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,683 copying build/lib/lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,685 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,687 copying build/lib/lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,688 copying build/lib/lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,690 copying build/lib/lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,692 copying build/lib/lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,694 copying build/lib/lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,696 copying build/lib/lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,697 copying build/lib/lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,699 copying build/lib/lm_eval/tasks/belebele/_belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,701 copying build/lib/lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,703 copying build/lib/lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,705 copying build/lib/lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,706 copying build/lib/lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,708 copying build/lib/lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,710 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,712 copying build/lib/lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,714 copying build/lib/lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,715 copying build/lib/lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,717 copying build/lib/lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,719 copying build/lib/lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,720 copying build/lib/lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,722 copying build/lib/lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,724 copying build/lib/lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,726 copying build/lib/lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,727 copying build/lib/lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,729 copying build/lib/lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,731 copying build/lib/lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,733 copying build/lib/lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,734 copying build/lib/lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,736 copying build/lib/lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,738 copying build/lib/lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,740 copying build/lib/lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,742 copying build/lib/lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,743 copying build/lib/lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,745 copying build/lib/lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,747 copying build/lib/lm_eval/tasks/belebele/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,749 copying build/lib/lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,751 copying build/lib/lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,753 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,755 copying build/lib/lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,757 copying build/lib/lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,759 copying build/lib/lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,760 copying build/lib/lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,762 copying build/lib/lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,764 copying build/lib/lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2026-09-01T00:16:23,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paws-x 2026-09-01T00:16:23,768 copying build/lib/lm_eval/tasks/paws-x/paws_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,769 copying build/lib/lm_eval/tasks/paws-x/pawsx_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,771 copying build/lib/lm_eval/tasks/paws-x/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,773 copying build/lib/lm_eval/tasks/paws-x/_pawsx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,774 copying build/lib/lm_eval/tasks/paws-x/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,776 copying build/lib/lm_eval/tasks/paws-x/paws_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,778 copying build/lib/lm_eval/tasks/paws-x/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,780 copying build/lib/lm_eval/tasks/paws-x/paws_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,781 copying build/lib/lm_eval/tasks/paws-x/paws_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,783 copying build/lib/lm_eval/tasks/paws-x/paws_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,785 copying build/lib/lm_eval/tasks/paws-x/paws_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,787 copying build/lib/lm_eval/tasks/paws-x/paws_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2026-09-01T00:16:23,789 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/copal_id 2026-09-01T00:16:23,790 copying build/lib/lm_eval/tasks/copal_id/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:16:23,792 copying build/lib/lm_eval/tasks/copal_id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:16:23,794 copying build/lib/lm_eval/tasks/copal_id/standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:16:23,796 copying build/lib/lm_eval/tasks/copal_id/colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2026-09-01T00:16:23,798 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm 2026-09-01T00:16:23,799 copying build/lib/lm_eval/tasks/afrimgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:16:23,801 copying build/lib/lm_eval/tasks/afrimgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:16:23,804 copying build/lib/lm_eval/tasks/afrimgsm/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:16:23,806 copying build/lib/lm_eval/tasks/afrimgsm/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:16:23,808 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:16:23,809 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot 2026-09-01T00:16:23,812 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,813 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,815 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,817 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,819 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,821 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,823 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,824 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,826 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,828 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,830 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,832 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,833 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,836 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,837 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,839 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,841 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,843 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,845 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,846 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,848 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_1 2026-09-01T00:16:23,851 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,852 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,854 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,855 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,857 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,859 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,861 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,863 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,865 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,866 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,868 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,870 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,872 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,873 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,876 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,878 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,879 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,881 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,883 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,885 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,887 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_4 2026-09-01T00:16:23,889 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,890 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,892 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,894 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,896 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,898 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,900 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,901 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,903 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,905 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,906 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,908 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,910 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,911 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,913 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,915 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,917 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,919 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,920 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,922 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,924 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_3 2026-09-01T00:16:23,926 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,927 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,929 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,931 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,933 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,935 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,937 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,939 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,941 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,943 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,944 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,946 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,948 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,950 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,952 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,953 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,955 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,957 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,959 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,961 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,962 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_5 2026-09-01T00:16:23,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,966 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,968 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,970 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,972 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,974 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,975 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,977 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,979 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,981 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,983 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,984 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,986 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,988 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,990 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,991 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,993 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,995 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,997 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:23,999 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:24,000 copying build/lib/lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct_cot/prompt_2 2026-09-01T00:16:24,003 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate 2026-09-01T00:16:24,004 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,006 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,008 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,010 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,011 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,013 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,015 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,017 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,019 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,021 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,023 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,024 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,026 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,028 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,030 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,031 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,033 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,035 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,037 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_1 2026-09-01T00:16:24,039 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,040 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,042 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,044 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,046 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,048 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,050 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,052 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,053 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,055 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,057 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,059 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,061 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,063 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,065 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,066 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,068 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,070 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,072 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_4 2026-09-01T00:16:24,074 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,075 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,077 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,079 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,081 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,082 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,084 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,086 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,088 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,090 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,091 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,093 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,095 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,097 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,099 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,101 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,102 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,104 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,106 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_3 2026-09-01T00:16:24,108 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2026-09-01T00:16:24,110 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,111 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,113 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,115 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,116 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,118 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,120 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,122 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,124 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,126 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,128 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,129 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,131 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,133 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,135 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,137 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,139 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,140 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,142 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_5 2026-09-01T00:16:24,144 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,146 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,147 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,149 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,151 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,152 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,154 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,156 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,158 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,159 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,161 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,163 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,165 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,166 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,168 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,170 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,172 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,174 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,176 copying build/lib/lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate/prompt_2 2026-09-01T00:16:24,178 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:16:24,180 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,181 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,183 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,184 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,186 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,188 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,189 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,191 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,193 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,195 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,196 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,198 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,200 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,202 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,203 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,205 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,207 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,208 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,210 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,212 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_1 2026-09-01T00:16:24,214 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot 2026-09-01T00:16:24,216 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,217 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,219 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,221 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,223 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,224 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,226 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,228 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,229 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,231 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,233 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,235 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,237 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,238 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,240 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,242 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,244 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,246 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,248 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,250 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_4 2026-09-01T00:16:24,252 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,253 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,255 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,257 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,258 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,260 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,262 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,263 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,265 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,266 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,268 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,270 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,272 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,273 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,275 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,277 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,279 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,280 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,282 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,284 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_3 2026-09-01T00:16:24,287 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,288 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,290 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,291 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,293 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,295 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,297 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,298 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,300 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,302 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,303 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,305 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,307 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,309 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,311 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,312 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,314 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,316 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,318 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,320 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_5 2026-09-01T00:16:24,322 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,323 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,325 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,327 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,329 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,330 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,332 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,333 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,335 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,337 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,339 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,340 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,342 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,344 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,346 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,347 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,349 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,351 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,353 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,354 copying build/lib/lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate_cot/prompt_2 2026-09-01T00:16:24,357 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct 2026-09-01T00:16:24,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,360 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,362 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,364 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,366 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,367 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,369 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,371 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,372 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,374 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,376 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,378 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,380 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,381 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,383 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,385 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,387 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,389 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,390 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,392 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,394 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_1 2026-09-01T00:16:24,396 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,397 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,399 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,401 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,403 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,405 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,406 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,408 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,410 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,411 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,413 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,415 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,417 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,419 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,420 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,422 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,424 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,426 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,428 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,429 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,431 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_4 2026-09-01T00:16:24,434 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,435 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,437 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,439 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,441 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,443 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,444 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,446 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,448 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,450 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,451 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,453 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,455 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,457 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,459 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,462 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,463 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,465 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,467 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,469 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,471 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_3 2026-09-01T00:16:24,473 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2026-09-01T00:16:24,475 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,476 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,478 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,480 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,482 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,483 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,485 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,487 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,489 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,491 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,493 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,494 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,496 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,498 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,499 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,501 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,503 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,505 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,506 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,508 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,510 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_5 2026-09-01T00:16:24,513 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,514 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,516 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,517 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,519 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,521 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,523 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,525 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,526 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,528 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,530 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,532 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,533 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,535 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,537 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,539 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,540 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,542 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,544 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,546 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,547 copying build/lib/lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct/prompt_2 2026-09-01T00:16:24,549 copying build/lib/lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2026-09-01T00:16:24,552 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mlqa 2026-09-01T00:16:24,553 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,555 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,557 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,558 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,560 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,562 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,563 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,566 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,567 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,569 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,571 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,573 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,574 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,576 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,578 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,580 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,582 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,584 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,585 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,587 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,589 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,590 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,592 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,594 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,595 copying build/lib/lm_eval/tasks/mlqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,597 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,599 copying build/lib/lm_eval/tasks/mlqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,601 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,603 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,604 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,606 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,608 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,610 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,611 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,613 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,615 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,616 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,618 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,620 copying build/lib/lm_eval/tasks/mlqa/mlqa_zh_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,622 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,623 copying build/lib/lm_eval/tasks/mlqa/mlqa_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,625 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,627 copying build/lib/lm_eval/tasks/mlqa/mlqa_vi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,629 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,630 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,632 copying build/lib/lm_eval/tasks/mlqa/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,634 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,636 copying build/lib/lm_eval/tasks/mlqa/mlqa_de_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,637 copying build/lib/lm_eval/tasks/mlqa/mlqa_en_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,639 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,641 copying build/lib/lm_eval/tasks/mlqa/mlqa_hi_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,642 copying build/lib/lm_eval/tasks/mlqa/mlqa_es_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,644 copying build/lib/lm_eval/tasks/mlqa/mlqa_ar_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mlqa 2026-09-01T00:16:24,646 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pisa 2026-09-01T00:16:24,647 copying build/lib/lm_eval/tasks/pisa/pisa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,649 copying build/lib/lm_eval/tasks/pisa/pisa_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,651 copying build/lib/lm_eval/tasks/pisa/pisa_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,652 copying build/lib/lm_eval/tasks/pisa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,654 copying build/lib/lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,656 copying build/lib/lm_eval/tasks/pisa/pisa_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,658 copying build/lib/lm_eval/tasks/pisa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,659 copying build/lib/lm_eval/tasks/pisa/pisa_en_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,661 copying build/lib/lm_eval/tasks/pisa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,663 copying build/lib/lm_eval/tasks/pisa/pisa_es_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,665 copying build/lib/lm_eval/tasks/pisa/_pisa_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,667 copying build/lib/lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,668 copying build/lib/lm_eval/tasks/pisa/pisa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,670 copying build/lib/lm_eval/tasks/pisa/_pisa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,672 copying build/lib/lm_eval/tasks/pisa/pisa_ch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,673 copying build/lib/lm_eval/tasks/pisa/pisa_it_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,675 copying build/lib/lm_eval/tasks/pisa/pisa_de_llm_judged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pisa 2026-09-01T00:16:24,677 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click 2026-09-01T00:16:24,679 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,680 copying build/lib/lm_eval/tasks/click/click_lang/_default_click_lang_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,682 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,684 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_function.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,686 copying build/lib/lm_eval/tasks/click/click_lang/click_lang_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,688 copying build/lib/lm_eval/tasks/click/click_lang/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,690 copying build/lib/lm_eval/tasks/click/click_lang/_click_lang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_lang 2026-09-01T00:16:24,692 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,693 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,695 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_kpop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,696 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_society.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,698 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,700 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_economy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,701 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,703 copying build/lib/lm_eval/tasks/click/click_cul/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,705 copying build/lib/lm_eval/tasks/click/click_cul/_default_click_cul_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,706 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_tradition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,708 copying build/lib/lm_eval/tasks/click/click_cul/_click_cul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,710 copying build/lib/lm_eval/tasks/click/click_cul/click_cul_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click/click_cul 2026-09-01T00:16:24,712 copying build/lib/lm_eval/tasks/click/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2026-09-01T00:16:24,713 copying build/lib/lm_eval/tasks/click/click.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/click 2026-09-01T00:16:24,716 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogender 2026-09-01T00:16:24,717 copying build/lib/lm_eval/tasks/winogender/winogender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,719 copying build/lib/lm_eval/tasks/winogender/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,721 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,723 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,724 copying build/lib/lm_eval/tasks/winogender/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,726 copying build/lib/lm_eval/tasks/winogender/winogender_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,728 copying build/lib/lm_eval/tasks/winogender/winogender_neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,730 copying build/lib/lm_eval/tasks/winogender/winogender_gotcha_female.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,731 copying build/lib/lm_eval/tasks/winogender/winogender_male.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogender 2026-09-01T00:16:24,734 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_prescriptions 2026-09-01T00:16:24,735 copying build/lib/lm_eval/tasks/med_prescriptions/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-09-01T00:16:24,739 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-09-01T00:16:24,740 copying build/lib/lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_prescriptions 2026-09-01T00:16:24,743 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k 2026-09-01T00:16:24,743 copying build/lib/lm_eval/tasks/hrm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k 2026-09-01T00:16:24,746 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,747 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,749 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,750 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,752 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,753 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,755 copying build/lib/lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,757 copying build/lib/lm_eval/tasks/hrm8k/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,759 copying build/lib/lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/en 2026-09-01T00:16:24,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,762 copying build/lib/lm_eval/tasks/hrm8k/default/_hrm8k_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,764 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,766 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,768 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,769 copying build/lib/lm_eval/tasks/hrm8k/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,771 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,773 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,775 copying build/lib/lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hrm8k/default 2026-09-01T00:16:24,777 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/indicxnli 2026-09-01T00:16:24,778 copying build/lib/lm_eval/tasks/indicxnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicxnli 2026-09-01T00:16:24,780 copying build/lib/lm_eval/tasks/indicxnli/indicxnli_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicxnli 2026-09-01T00:16:24,782 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,783 copying build/lib/lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,785 copying build/lib/lm_eval/tasks/xstorycloze/default_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,787 copying build/lib/lm_eval/tasks/xstorycloze/default_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,789 copying build/lib/lm_eval/tasks/xstorycloze/default_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,790 copying build/lib/lm_eval/tasks/xstorycloze/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,792 copying build/lib/lm_eval/tasks/xstorycloze/default_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,794 copying build/lib/lm_eval/tasks/xstorycloze/default_my.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,795 copying build/lib/lm_eval/tasks/xstorycloze/default_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,797 copying build/lib/lm_eval/tasks/xstorycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,799 copying build/lib/lm_eval/tasks/xstorycloze/default_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,800 copying build/lib/lm_eval/tasks/xstorycloze/default_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,802 copying build/lib/lm_eval/tasks/xstorycloze/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,804 copying build/lib/lm_eval/tasks/xstorycloze/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2026-09-01T00:16:24,806 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/groundcocoa 2026-09-01T00:16:24,807 copying build/lib/lm_eval/tasks/groundcocoa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-09-01T00:16:24,809 copying build/lib/lm_eval/tasks/groundcocoa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-09-01T00:16:24,810 copying build/lib/lm_eval/tasks/groundcocoa/groundcocoa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/groundcocoa 2026-09-01T00:16:24,813 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval 2026-09-01T00:16:24,814 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:16:24,815 copying build/lib/lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norrewrite-instruct 2026-09-01T00:16:24,818 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:16:24,819 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:16:24,820 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:16:24,822 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:16:24,824 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:16:24,826 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:16:24,827 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nno 2026-09-01T00:16:24,829 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:16:24,831 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa 2026-09-01T00:16:24,833 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:16:24,834 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:16:24,836 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:16:24,838 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:16:24,840 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:16:24,841 copying build/lib/lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noropenbookqa/nob 2026-09-01T00:16:24,843 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm 2026-09-01T00:16:24,844 copying build/lib/lm_eval/tasks/noreval/norsumm/_norsumm_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2026-09-01T00:16:24,846 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,847 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,849 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,851 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,852 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,854 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,856 copying build/lib/lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nno 2026-09-01T00:16:24,858 copying build/lib/lm_eval/tasks/noreval/norsumm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm 2026-09-01T00:16:24,860 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,861 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,863 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,865 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,866 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,868 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,870 copying build/lib/lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsumm/nob 2026-09-01T00:16:24,872 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ncb 2026-09-01T00:16:24,873 copying build/lib/lm_eval/tasks/noreval/ncb/ncb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ncb 2026-09-01T00:16:24,876 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa 2026-09-01T00:16:24,877 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa 2026-09-01T00:16:24,879 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:16:24,880 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:16:24,882 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:16:24,884 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:16:24,886 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:16:24,888 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nno 2026-09-01T00:16:24,890 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:16:24,891 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:16:24,893 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:16:24,895 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:16:24,896 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:16:24,898 copying build/lib/lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norcommonsenseqa/nob 2026-09-01T00:16:24,900 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa 2026-09-01T00:16:24,902 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:16:24,903 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:16:24,904 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:16:24,906 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:16:24,908 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:16:24,910 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:16:24,912 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nno 2026-09-01T00:16:24,914 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:16:24,916 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation 2026-09-01T00:16:24,918 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:16:24,919 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:16:24,921 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:16:24,923 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:16:24,925 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:16:24,927 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/generation/nob 2026-09-01T00:16:24,929 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-09-01T00:16:24,931 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,932 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,934 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,936 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,938 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,940 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,942 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno 2026-09-01T00:16:24,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,945 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,947 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,948 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,950 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,952 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,953 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob 2026-09-01T00:16:24,955 copying build/lib/lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nortruthfulqa/multiple_choice 2026-09-01T00:16:24,957 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba 2026-09-01T00:16:24,959 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:16:24,960 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:16:24,962 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:16:24,964 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:16:24,965 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob 2026-09-01T00:16:24,967 copying build/lib/lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba 2026-09-01T00:16:24,969 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:16:24,970 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:16:24,972 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:16:24,973 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:16:24,975 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng 2026-09-01T00:16:24,977 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:16:24,978 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:16:24,980 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:16:24,982 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:16:24,984 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng 2026-09-01T00:16:24,987 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:16:24,988 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:16:24,989 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:16:24,991 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:16:24,993 copying build/lib/lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno 2026-09-01T00:16:24,995 copying build/lib/lm_eval/tasks/noreval/noreval.jpg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2026-09-01T00:16:25,007 copying build/lib/lm_eval/tasks/noreval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval 2026-09-01T00:16:25,010 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:16:25,011 copying build/lib/lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norsummarize-instruct 2026-09-01T00:16:25,014 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,015 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,016 copying build/lib/lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,018 copying build/lib/lm_eval/tasks/noreval/ask_gec/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,020 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,021 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,023 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,025 copying build/lib/lm_eval/tasks/noreval/ask_gec/errant.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,027 copying build/lib/lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/ask_gec 2026-09-01T00:16:25,029 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,030 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,032 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,034 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,036 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,037 copying build/lib/lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,039 copying build/lib/lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norbelebele 2026-09-01T00:16:25,042 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa 2026-09-01T00:16:25,043 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa 2026-09-01T00:16:25,045 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,046 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,048 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,049 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,051 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,053 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,055 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nno 2026-09-01T00:16:25,057 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,058 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,060 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,062 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,063 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,065 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,067 copying build/lib/lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/nrk_quiz_qa/nob 2026-09-01T00:16:25,069 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,070 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,072 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,073 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,075 copying build/lib/lm_eval/tasks/noreval/norquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,077 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,079 copying build/lib/lm_eval/tasks/noreval/norquad/_norquad_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,080 copying build/lib/lm_eval/tasks/noreval/norquad/norquad_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norquad 2026-09-01T00:16:25,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec 2026-09-01T00:16:25,084 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:16:25,085 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:16:25,087 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:16:25,089 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:16:25,091 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:16:25,092 copying build/lib/lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_sentence 2026-09-01T00:16:25,094 copying build/lib/lm_eval/tasks/noreval/norec/_norec_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2026-09-01T00:16:25,096 copying build/lib/lm_eval/tasks/noreval/norec/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec 2026-09-01T00:16:25,098 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:16:25,099 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:16:25,101 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:16:25,103 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:16:25,104 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:16:25,106 copying build/lib/lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/norec/norec_document 2026-09-01T00:16:25,108 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom 2026-09-01T00:16:25,109 copying build/lib/lm_eval/tasks/noreval/noridiom/_noridiom_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2026-09-01T00:16:25,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:16:25,112 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:16:25,114 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:16:25,116 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:16:25,117 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:16:25,119 copying build/lib/lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nno 2026-09-01T00:16:25,121 copying build/lib/lm_eval/tasks/noreval/noridiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom 2026-09-01T00:16:25,123 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:16:25,124 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:16:25,126 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:16:25,127 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:16:25,129 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:16:25,131 copying build/lib/lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noreval/noridiom/nob 2026-09-01T00:16:25,133 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fda 2026-09-01T00:16:25,134 copying build/lib/lm_eval/tasks/fda/fda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-09-01T00:16:25,136 copying build/lib/lm_eval/tasks/fda/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-09-01T00:16:25,138 copying build/lib/lm_eval/tasks/fda/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2026-09-01T00:16:25,140 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bear 2026-09-01T00:16:25,141 copying build/lib/lm_eval/tasks/bear/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-09-01T00:16:25,143 copying build/lib/lm_eval/tasks/bear/bear_big.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-09-01T00:16:25,145 copying build/lib/lm_eval/tasks/bear/bear.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bear 2026-09-01T00:16:25,147 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_cloze 2026-09-01T00:16:25,148 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-09-01T00:16:25,150 copying build/lib/lm_eval/tasks/lambada_cloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-09-01T00:16:25,152 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2026-09-01T00:16:25,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babi 2026-09-01T00:16:25,155 copying build/lib/lm_eval/tasks/babi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2026-09-01T00:16:25,157 copying build/lib/lm_eval/tasks/babi/babi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2026-09-01T00:16:25,159 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mastermind 2026-09-01T00:16:25,160 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,162 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,164 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,166 copying build/lib/lm_eval/tasks/mastermind/mastermind_24_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,167 copying build/lib/lm_eval/tasks/mastermind/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,169 copying build/lib/lm_eval/tasks/mastermind/mastermind_35_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,171 copying build/lib/lm_eval/tasks/mastermind/mastermind_46_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mastermind 2026-09-01T00:16:25,173 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xquad 2026-09-01T00:16:25,174 copying build/lib/lm_eval/tasks/xquad/xquad_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,176 copying build/lib/lm_eval/tasks/xquad/xquad_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,178 copying build/lib/lm_eval/tasks/xquad/xquad_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,179 copying build/lib/lm_eval/tasks/xquad/xquad_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,181 copying build/lib/lm_eval/tasks/xquad/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,183 copying build/lib/lm_eval/tasks/xquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,185 copying build/lib/lm_eval/tasks/xquad/xquad_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,186 copying build/lib/lm_eval/tasks/xquad/xquad_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,188 copying build/lib/lm_eval/tasks/xquad/xquad_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,190 copying build/lib/lm_eval/tasks/xquad/xquad_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,192 copying build/lib/lm_eval/tasks/xquad/xquad_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,193 copying build/lib/lm_eval/tasks/xquad/xquad_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,195 copying build/lib/lm_eval/tasks/xquad/xquad_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,197 copying build/lib/lm_eval/tasks/xquad/xquad_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,199 copying build/lib/lm_eval/tasks/xquad/xquad_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2026-09-01T00:16:25,201 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli 2026-09-01T00:16:25,202 copying build/lib/lm_eval/tasks/afrixnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-09-01T00:16:25,204 copying build/lib/lm_eval/tasks/afrixnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-09-01T00:16:25,206 copying build/lib/lm_eval/tasks/afrixnli/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2026-09-01T00:16:25,209 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate 2026-09-01T00:16:25,211 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,212 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,213 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,215 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,217 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,219 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,220 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,222 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,224 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,225 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,227 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,229 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,230 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,232 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,234 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,235 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,237 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,239 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,241 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,242 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_1 2026-09-01T00:16:25,245 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,246 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,248 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,249 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,251 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,252 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,254 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,256 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,257 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,259 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,261 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,262 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,264 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,266 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,267 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,269 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,271 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,272 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,274 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,276 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_4 2026-09-01T00:16:25,278 copying build/lib/lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate 2026-09-01T00:16:25,280 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,281 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,283 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,284 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,286 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,288 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,289 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,291 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,292 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,294 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,295 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,297 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,299 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,300 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,302 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,304 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,306 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,307 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,309 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,311 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_3 2026-09-01T00:16:25,313 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,314 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,316 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,318 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,319 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,321 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,323 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,324 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,326 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,328 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,329 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,331 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,333 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,335 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,336 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,338 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,340 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,342 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,344 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,346 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_5 2026-09-01T00:16:25,348 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,349 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,351 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,353 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,355 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,356 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,358 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,360 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,361 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,363 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,365 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,367 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,368 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,370 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,372 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,374 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,376 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,377 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,379 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,381 copying build/lib/lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/translate/prompt_2 2026-09-01T00:16:25,383 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt 2026-09-01T00:16:25,385 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,386 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,388 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,390 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,392 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,394 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,396 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,397 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,399 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,401 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,403 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,404 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,406 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,408 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,410 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,411 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,413 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,415 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,417 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,419 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2026-09-01T00:16:25,421 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,422 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,424 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,426 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,428 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,429 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,431 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,433 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,435 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,436 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,438 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,440 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,442 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,443 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,445 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,447 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,449 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,450 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,452 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,454 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,456 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2026-09-01T00:16:25,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct 2026-09-01T00:16:25,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,461 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,462 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,464 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,466 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,468 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,470 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,472 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,473 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,475 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,477 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,479 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,481 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,483 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,484 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,486 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,488 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,490 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,492 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,493 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,495 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_1 2026-09-01T00:16:25,498 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,499 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,501 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,502 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,504 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,506 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,508 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,509 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,511 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,513 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,515 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,517 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,519 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,520 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,522 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,524 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,526 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,527 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,529 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,531 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,532 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_4 2026-09-01T00:16:25,535 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,536 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,538 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,539 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,541 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,543 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,545 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,547 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,549 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,550 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,553 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,554 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,556 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,558 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,560 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,561 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,563 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,565 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,567 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,569 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,570 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_3 2026-09-01T00:16:25,572 copying build/lib/lm_eval/tasks/afrixnli/direct/afrixnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct 2026-09-01T00:16:25,574 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,575 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,577 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,579 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,581 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,583 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,585 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,587 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,589 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,591 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,593 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,595 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,596 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,598 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,600 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,602 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,604 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,606 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,607 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,609 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,611 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_5 2026-09-01T00:16:25,613 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,614 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,617 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,618 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,620 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,622 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,624 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,625 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,627 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,629 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,631 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,633 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,635 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,636 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,638 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,640 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,642 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,644 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,646 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,648 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,650 copying build/lib/lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/direct/prompt_2 2026-09-01T00:16:25,652 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt 2026-09-01T00:16:25,654 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,655 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,657 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,659 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,661 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,663 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,664 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,666 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,668 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,670 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,671 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,673 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,675 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,677 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,679 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,680 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,682 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,684 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,686 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,688 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,690 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2026-09-01T00:16:25,693 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,694 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,696 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,698 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,700 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,702 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,704 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,706 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,708 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,709 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,711 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,713 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,715 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,717 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,719 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,721 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,722 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,724 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,726 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,728 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,730 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2026-09-01T00:16:25,732 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,733 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,736 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,737 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,739 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,741 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,743 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,745 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,747 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,749 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,750 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,752 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,754 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,756 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,758 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,760 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,762 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,764 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,766 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,768 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2026-09-01T00:16:25,771 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture 2026-09-01T00:16:25,772 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,774 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,776 copying build/lib/lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,777 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,779 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,781 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,783 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,784 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,786 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,788 copying build/lib/lm_eval/tasks/arab_culture/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,790 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,792 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,794 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,796 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,798 copying build/lib/lm_eval/tasks/arab_culture/utils_mcq.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,800 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,802 copying build/lib/lm_eval/tasks/arab_culture/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,804 copying build/lib/lm_eval/tasks/arab_culture/_arab_culture_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,806 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,808 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,809 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,811 copying build/lib/lm_eval/tasks/arab_culture/arab_culture_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,813 copying build/lib/lm_eval/tasks/arab_culture/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture 2026-09-01T00:16:25,815 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pubmedqa 2026-09-01T00:16:25,816 copying build/lib/lm_eval/tasks/pubmedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-09-01T00:16:25,818 copying build/lib/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-09-01T00:16:25,820 copying build/lib/lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2026-09-01T00:16:25,824 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,825 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,827 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,828 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,830 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,832 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,834 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,836 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,838 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,840 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,841 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,843 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,845 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,847 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,849 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,851 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,853 copying build/lib/lm_eval/tasks/lm_syneval/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,855 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,857 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,859 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,860 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,862 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,864 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,866 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,868 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,870 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,871 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,873 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,875 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,877 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,879 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,881 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,883 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,885 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,887 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,888 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,890 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,892 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,894 copying build/lib/lm_eval/tasks/lm_syneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,896 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,898 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,900 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,902 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,904 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,906 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,908 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,909 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,911 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,913 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,914 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,916 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,918 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,920 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,922 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,924 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,926 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,928 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,930 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,932 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,934 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,935 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,937 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,939 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,941 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,942 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,944 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,946 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,947 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,949 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,951 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,952 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,954 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,956 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,957 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,959 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,961 copying build/lib/lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lm_syneval 2026-09-01T00:16:25,964 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/agieval 2026-09-01T00:16:25,964 copying build/lib/lm_eval/tasks/agieval/logiqa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,966 copying build/lib/lm_eval/tasks/agieval/sat-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,968 copying build/lib/lm_eval/tasks/agieval/agieval_nous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,970 copying build/lib/lm_eval/tasks/agieval/agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,971 copying build/lib/lm_eval/tasks/agieval/lsat-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,973 copying build/lib/lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,975 copying build/lib/lm_eval/tasks/agieval/aqua-rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,977 copying build/lib/lm_eval/tasks/agieval/math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,979 copying build/lib/lm_eval/tasks/agieval/agieval_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,981 copying build/lib/lm_eval/tasks/agieval/gaokao-biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,983 copying build/lib/lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,984 copying build/lib/lm_eval/tasks/agieval/lsat-rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,986 copying build/lib/lm_eval/tasks/agieval/gaokao-physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,988 copying build/lib/lm_eval/tasks/agieval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,990 copying build/lib/lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,991 copying build/lib/lm_eval/tasks/agieval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,993 copying build/lib/lm_eval/tasks/agieval/gaokao-geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,995 copying build/lib/lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,997 copying build/lib/lm_eval/tasks/agieval/agieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:25,999 copying build/lib/lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,001 copying build/lib/lm_eval/tasks/agieval/logiqa-zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,003 copying build/lib/lm_eval/tasks/agieval/gaokao-english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,005 copying build/lib/lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,006 copying build/lib/lm_eval/tasks/agieval/sat-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,008 copying build/lib/lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,010 copying build/lib/lm_eval/tasks/agieval/gaokao-history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,012 copying build/lib/lm_eval/tasks/agieval/lsat-lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2026-09-01T00:16:26,016 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,017 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,019 copying build/lib/lm_eval/tasks/zhoblimp/verb_negation_particle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,020 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,022 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,024 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,026 copying build/lib/lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,028 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,029 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,031 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,033 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,035 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,036 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,039 copying build/lib/lm_eval/tasks/zhoblimp/you_yige.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,041 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,042 copying build/lib/lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,044 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,046 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,048 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,050 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_nandao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,052 copying build/lib/lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,053 copying build/lib/lm_eval/tasks/zhoblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,055 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,057 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,059 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,060 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,062 copying build/lib/lm_eval/tasks/zhoblimp/agent_causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,064 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,066 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,067 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,069 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,071 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,072 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,074 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,076 copying build/lib/lm_eval/tasks/zhoblimp/BA_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,077 copying build/lib/lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,079 copying build/lib/lm_eval/tasks/zhoblimp/BA_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,081 copying build/lib/lm_eval/tasks/zhoblimp/causative_shi_ba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,082 copying build/lib/lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,084 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,086 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,087 copying build/lib/lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,089 copying build/lib/lm_eval/tasks/zhoblimp/agent_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,090 copying build/lib/lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,092 copying build/lib/lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,094 copying build/lib/lm_eval/tasks/zhoblimp/BEI_construction_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,095 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,097 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,099 copying build/lib/lm_eval/tasks/zhoblimp/passive_intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,100 copying build/lib/lm_eval/tasks/zhoblimp/ya_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,102 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,104 copying build/lib/lm_eval/tasks/zhoblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,105 copying build/lib/lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,107 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,109 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,110 copying build/lib/lm_eval/tasks/zhoblimp/BA_no_progressive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,112 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,114 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,116 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,118 copying build/lib/lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,120 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,122 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,123 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,125 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,127 copying build/lib/lm_eval/tasks/zhoblimp/passive_suo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,129 copying build/lib/lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,131 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,133 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_hui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,134 copying build/lib/lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,136 copying build/lib/lm_eval/tasks/zhoblimp/BA_inversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,138 copying build/lib/lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,140 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,142 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,143 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,145 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,147 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,149 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,151 copying build/lib/lm_eval/tasks/zhoblimp/BA_meiba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,153 copying build/lib/lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,155 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,157 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,158 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,160 copying build/lib/lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,162 copying build/lib/lm_eval/tasks/zhoblimp/right_yijing_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,164 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_domain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,166 copying build/lib/lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,168 copying build/lib/lm_eval/tasks/zhoblimp/BEI_preposition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,170 copying build/lib/lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,172 copying build/lib/lm_eval/tasks/zhoblimp/question_nandao_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,174 copying build/lib/lm_eval/tasks/zhoblimp/BEI_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,176 copying build/lib/lm_eval/tasks/zhoblimp/PN_numP_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,177 copying build/lib/lm_eval/tasks/zhoblimp/relative_operator_who.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,179 copying build/lib/lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,180 copying build/lib/lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,182 copying build/lib/lm_eval/tasks/zhoblimp/passive_no_adj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,183 copying build/lib/lm_eval/tasks/zhoblimp/passive_body_part.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,185 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,187 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_d.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,189 copying build/lib/lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,190 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,192 copying build/lib/lm_eval/tasks/zhoblimp/zhoblimp_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,194 copying build/lib/lm_eval/tasks/zhoblimp/preposition_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,196 copying build/lib/lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,198 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,200 copying build/lib/lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,201 copying build/lib/lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,203 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,205 copying build/lib/lm_eval/tasks/zhoblimp/left_dou.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,207 copying build/lib/lm_eval/tasks/zhoblimp/preposition_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,208 copying build/lib/lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,210 copying build/lib/lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,212 copying build/lib/lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,213 copying build/lib/lm_eval/tasks/zhoblimp/question_A_not_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,215 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,217 copying build/lib/lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,219 copying build/lib/lm_eval/tasks/zhoblimp/nominal_definite_men.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,220 copying build/lib/lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,222 copying build/lib/lm_eval/tasks/zhoblimp/left_adverbial_b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,224 copying build/lib/lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,226 copying build/lib/lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,227 copying build/lib/lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,229 copying build/lib/lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/zhoblimp 2026-09-01T00:16:26,232 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mts_dialog 2026-09-01T00:16:26,233 copying build/lib/lm_eval/tasks/mts_dialog/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:16:26,235 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:16:26,236 copying build/lib/lm_eval/tasks/mts_dialog/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:16:26,238 copying build/lib/lm_eval/tasks/mts_dialog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:16:26,240 copying build/lib/lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mts_dialog 2026-09-01T00:16:26,243 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,244 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,246 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,248 copying build/lib/lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,250 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,252 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,253 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,255 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,257 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,258 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,260 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,262 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,264 copying build/lib/lm_eval/tasks/med_concepts_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,265 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,267 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,269 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,271 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,272 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,274 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,276 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,277 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,279 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,280 copying build/lib/lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,282 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,284 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2026-09-01T00:16:26,287 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bhs 2026-09-01T00:16:26,288 copying build/lib/lm_eval/tasks/bhs/bhs_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,290 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,291 copying build/lib/lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,293 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,295 copying build/lib/lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,296 copying build/lib/lm_eval/tasks/bhs/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,298 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,300 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,302 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,304 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,305 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,307 copying build/lib/lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,309 copying build/lib/lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,311 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,312 copying build/lib/lm_eval/tasks/bhs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,315 copying build/lib/lm_eval/tasks/bhs/bhs_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,316 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,318 copying build/lib/lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,320 copying build/lib/lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,321 copying build/lib/lm_eval/tasks/bhs/hindi-S_O_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,323 copying build/lib/lm_eval/tasks/bhs/bhs_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,325 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,326 copying build/lib/lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,328 copying build/lib/lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,330 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,331 copying build/lib/lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,333 copying build/lib/lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bhs 2026-09-01T00:16:26,336 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite 2026-09-01T00:16:26,338 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,339 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/_toksuite_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,341 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_romanization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,344 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,346 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,348 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,350 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_partially_romanized.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,352 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,355 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_traditional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,357 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_ocr_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,359 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,361 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,363 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,366 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_optional_diacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,368 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_word_spacing_zero-width_characters_extra_space.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,370 copying build/lib/lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_chinese 2026-09-01T00:16:26,373 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,374 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,376 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,378 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/_toksuite_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,380 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,382 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,384 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_derivations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,387 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_inflections.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,389 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_similar_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,391 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,393 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_orthographic_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,395 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_english_keyboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,397 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_web_search_query.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,400 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,402 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_typographical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,404 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,406 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,408 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_date_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,410 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_grammatical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,413 copying build/lib/lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_word_reordering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_turkish 2026-09-01T00:16:26,415 copying build/lib/lm_eval/tasks/toksuite/_toksuite_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:16:26,417 copying build/lib/lm_eval/tasks/toksuite/_toksuite_abridged.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:16:26,419 copying build/lib/lm_eval/tasks/toksuite/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:16:26,421 copying build/lib/lm_eval/tasks/toksuite/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite 2026-09-01T00:16:26,426 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,427 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spaced_styling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,429 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_macron_diacritic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,431 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_lowercase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,433 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_emoji_substitution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,436 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,437 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,439 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_word_reordering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,441 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_substitution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,442 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,444 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_date_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,446 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_capitalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,447 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_contractions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,449 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_ocr_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,451 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,452 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,455 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/_toksuite_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,457 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_web_search_query.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,458 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_scripted_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,460 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_grammatical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,461 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_letter_repetition_for_emphasis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,464 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_historical_spelling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,466 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_inflections.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,468 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_similar_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,470 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_hyphenated_spelling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,471 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_homoglyphs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,473 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,475 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_compounds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,477 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_superscript_subscript_styling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,478 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_abbreviations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,480 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_orthographic_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,482 copying build/lib/lm_eval/tasks/toksuite/toksuite_english/toksuite_english_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_english 2026-09-01T00:16:26,485 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,486 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_romanization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,488 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,489 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,491 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,493 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,495 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_word_spacing_zero-width_characters_extra_space.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,497 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,498 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,501 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_number_romanization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,502 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,504 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_optional_diacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,506 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_arabic_keyboard_for_farsi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,507 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,509 copying build/lib/lm_eval/tasks/toksuite/toksuite_farsi/_toksuite_farsi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_farsi 2026-09-01T00:16:26,511 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,512 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_latex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,514 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,516 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_farsi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,518 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/_toksuite_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,520 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,521 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,523 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,525 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_decorative_unicode.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,527 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,528 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,530 copying build/lib/lm_eval/tasks/toksuite/toksuite_math/toksuite_math_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_math 2026-09-01T00:16:26,532 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,534 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,536 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/_toksuite_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,537 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_capitalization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,539 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_code_language_script_switching.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,541 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_plausible_diacritics_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,542 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_numerical_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,544 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_phonetic_spelling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,546 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_similar_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,547 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_contractions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,549 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_keyboard_proximity_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,551 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_date_formats.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,552 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_grammatical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,554 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_orthographic_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,556 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,558 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_web_search_query.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,559 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_english_keyboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,561 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_typographical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,562 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,564 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,566 copying build/lib/lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_abbreviations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_italian 2026-09-01T00:16:26,569 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,570 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_diacriticized_styling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,572 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_latex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,573 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_upside_down_rotated.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,575 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,577 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_enclosed_characters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,578 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_spelled_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,580 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_double_struck.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,581 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unusual_formatting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,583 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,585 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_strikethrough.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,586 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_morpheme_separation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,588 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/_toksuite_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,590 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_space_removal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,591 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_fullwidth_characters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,593 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_superscript_subscript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,595 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unicode_formatting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,596 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_typographical_errors.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,599 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_character_deletion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,601 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_equivalent_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,603 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_scripted_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,605 copying build/lib/lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_canonical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toksuite/toksuite_stem 2026-09-01T00:16:26,607 copying build/lib/lm_eval/tasks/manager.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:16:26,609 copying build/lib/lm_eval/tasks/_yaml_loader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:16:26,613 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,614 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,616 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,618 copying build/lib/lm_eval/tasks/evalita_llm/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,619 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,621 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,623 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,624 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,626 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,628 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,630 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,631 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,633 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,635 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,637 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,638 copying build/lib/lm_eval/tasks/evalita_llm/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,641 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,642 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,644 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,646 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,647 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,649 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,651 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,652 copying build/lib/lm_eval/tasks/evalita_llm/_ls_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,654 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,656 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,658 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,660 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,661 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,663 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,664 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,666 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,668 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,670 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,672 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,675 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,677 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,680 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,682 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,684 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,686 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,689 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,694 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,697 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,700 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,703 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,707 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,710 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,714 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,718 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,720 copying build/lib/lm_eval/tasks/evalita_llm/_wic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,723 copying build/lib/lm_eval/tasks/evalita_llm/_re_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,726 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,729 copying build/lib/lm_eval/tasks/evalita_llm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,730 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,732 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,734 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,736 copying build/lib/lm_eval/tasks/evalita_llm/_faq_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,737 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,739 copying build/lib/lm_eval/tasks/evalita_llm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,741 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,743 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,744 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,746 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,748 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,750 copying build/lib/lm_eval/tasks/evalita_llm/_at_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,751 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,753 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,755 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_v2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,757 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,758 copying build/lib/lm_eval/tasks/evalita_llm/_sa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,760 copying build/lib/lm_eval/tasks/evalita_llm/sum_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,762 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,763 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,765 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,767 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,769 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,770 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,772 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,774 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,776 copying build/lib/lm_eval/tasks/evalita_llm/_ner_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,778 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,780 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,781 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,783 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,786 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,787 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,790 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,792 copying build/lib/lm_eval/tasks/evalita_llm/_hs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,795 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,798 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,801 copying build/lib/lm_eval/tasks/evalita_llm/_sum_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,803 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,805 copying build/lib/lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/evalita_llm 2026-09-01T00:16:26,808 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/infinitebench 2026-09-01T00:16:26,809 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_math_find.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,811 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_qa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,813 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_sum_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,815 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_code_debug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,817 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_choice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,819 copying build/lib/lm_eval/tasks/infinitebench/_infinitebench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,821 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_kv_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,823 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,826 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longbook_qa_chn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,828 copying build/lib/lm_eval/tasks/infinitebench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,830 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_code_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,833 copying build/lib/lm_eval/tasks/infinitebench/infinitebench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,836 copying build/lib/lm_eval/tasks/infinitebench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,838 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_number_string.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,840 copying build/lib/lm_eval/tasks/infinitebench/infinitebench_longdialogue_qa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/infinitebench 2026-09-01T00:16:26,842 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wsc273 2026-09-01T00:16:26,843 copying build/lib/lm_eval/tasks/wsc273/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-09-01T00:16:26,845 copying build/lib/lm_eval/tasks/wsc273/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-09-01T00:16:26,847 copying build/lib/lm_eval/tasks/wsc273/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2026-09-01T00:16:26,849 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa 2026-09-01T00:16:26,850 copying build/lib/lm_eval/tasks/logiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-09-01T00:16:26,852 copying build/lib/lm_eval/tasks/logiqa/utils_logiqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-09-01T00:16:26,854 copying build/lib/lm_eval/tasks/logiqa/logiqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2026-09-01T00:16:26,857 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue 2026-09-01T00:16:26,858 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,860 copying build/lib/lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,862 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,863 copying build/lib/lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,865 copying build/lib/lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,868 copying build/lib/lm_eval/tasks/code_x_glue/code-text/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,870 copying build/lib/lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,871 copying build/lib/lm_eval/tasks/code_x_glue/code-text/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,874 copying build/lib/lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,876 copying build/lib/lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,878 copying build/lib/lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,880 copying build/lib/lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2026-09-01T00:16:26,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/histoires_morales 2026-09-01T00:16:26,884 copying build/lib/lm_eval/tasks/histoires_morales/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-09-01T00:16:26,887 copying build/lib/lm_eval/tasks/histoires_morales/histoires_morales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-09-01T00:16:26,889 copying build/lib/lm_eval/tasks/histoires_morales/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/histoires_morales 2026-09-01T00:16:26,892 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:16:26,893 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:16:26,895 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:16:26,898 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:16:26,900 copying build/lib/lm_eval/tasks/simple_cooccurrence_bias/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/simple_cooccurrence_bias 2026-09-01T00:16:26,903 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,904 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,906 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,909 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,911 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,913 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,915 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,917 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,919 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,921 copying build/lib/lm_eval/tasks/truthfulqa-multi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,923 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,925 copying build/lib/lm_eval/tasks/truthfulqa-multi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,927 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,929 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,931 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,933 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,935 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,937 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,939 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,941 copying build/lib/lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa-multi 2026-09-01T00:16:26,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa 2026-09-01T00:16:26,946 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,947 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,949 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,951 copying build/lib/lm_eval/tasks/gpqa/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,953 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,955 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,958 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2026-09-01T00:16:26,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,962 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,964 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,966 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,968 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,970 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,972 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2026-09-01T00:16:26,975 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,976 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,978 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,981 copying build/lib/lm_eval/tasks/gpqa/n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,983 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,985 copying build/lib/lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,987 copying build/lib/lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2026-09-01T00:16:26,989 copying build/lib/lm_eval/tasks/gpqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa 2026-09-01T00:16:26,992 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:26,993 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:26,996 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:26,998 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:27,000 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:27,002 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:27,004 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2026-09-01T00:16:27,007 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,008 copying build/lib/lm_eval/tasks/gpqa/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,010 copying build/lib/lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,013 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,014 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,017 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,019 copying build/lib/lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2026-09-01T00:16:27,022 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/scrolls 2026-09-01T00:16:27,023 copying build/lib/lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,026 copying build/lib/lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,028 copying build/lib/lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,030 copying build/lib/lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,033 copying build/lib/lm_eval/tasks/scrolls/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,035 copying build/lib/lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,037 copying build/lib/lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,040 copying build/lib/lm_eval/tasks/scrolls/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,043 copying build/lib/lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2026-09-01T00:16:27,046 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,047 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,049 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,052 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,054 copying build/lib/lm_eval/tasks/hendrycks_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,056 copying build/lib/lm_eval/tasks/hendrycks_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,059 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,061 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,063 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,065 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,067 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,069 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2026-09-01T00:16:27,072 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox 2026-09-01T00:16:27,074 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,076 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,079 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,081 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,083 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,085 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,087 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,089 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,091 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,093 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,095 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,098 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,100 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,102 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,104 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,106 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,108 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,110 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,112 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,114 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,116 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,118 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,120 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,122 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,124 copying build/lib/lm_eval/tasks/mmlu_prox/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,126 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,128 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,130 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,132 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,134 copying build/lib/lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,136 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,138 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,141 copying build/lib/lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,143 copying build/lib/lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/id 2026-09-01T00:16:27,147 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,149 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,151 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,154 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,156 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,159 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,161 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,164 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,166 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,169 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,171 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,174 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,177 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,179 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,182 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,184 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,187 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,190 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,192 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,194 copying build/lib/lm_eval/tasks/mmlu_prox/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,197 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,200 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,202 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,205 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,208 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,210 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,212 copying build/lib/lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,215 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,217 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,220 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,222 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,225 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,227 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,230 copying build/lib/lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ar 2026-09-01T00:16:27,233 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,235 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,237 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,240 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,242 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,244 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,246 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,466 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,467 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,469 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,471 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,472 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,474 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,476 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,478 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,480 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,481 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,483 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,485 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,487 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,489 copying build/lib/lm_eval/tasks/mmlu_prox/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,490 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,492 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,494 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,496 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,498 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,500 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,502 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,503 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,505 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,507 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,509 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,510 copying build/lib/lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,512 copying build/lib/lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/yo 2026-09-01T00:16:27,515 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,516 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,517 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,519 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,521 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,523 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,525 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,526 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,528 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,530 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,531 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,533 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,535 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,537 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,538 copying build/lib/lm_eval/tasks/mmlu_prox/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,540 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,542 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,544 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,546 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,547 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,549 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,551 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,552 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,554 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,556 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,558 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,559 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,561 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,563 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,565 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,566 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,568 copying build/lib/lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,570 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,572 copying build/lib/lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hi 2026-09-01T00:16:27,575 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,576 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,578 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,580 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,581 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,583 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,585 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,587 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,589 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,591 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,593 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,595 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,597 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,599 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,601 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,603 copying build/lib/lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,604 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,606 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,608 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,610 copying build/lib/lm_eval/tasks/mmlu_prox/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,611 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,613 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,615 copying build/lib/lm_eval/tasks/mmlu_prox/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,617 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,618 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,620 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,622 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,624 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,625 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,627 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,629 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,631 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,633 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,634 copying build/lib/lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/de 2026-09-01T00:16:27,637 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,638 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,640 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,642 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,644 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,646 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,648 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,649 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,651 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,653 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,654 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,656 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,657 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,659 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,661 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,662 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,664 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,666 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,668 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,669 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,671 copying build/lib/lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,673 copying build/lib/lm_eval/tasks/mmlu_prox/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,675 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,676 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,678 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,680 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,682 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,684 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,686 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,687 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,689 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,690 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,692 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,694 copying build/lib/lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ja 2026-09-01T00:16:27,696 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,698 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,699 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,701 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,703 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,705 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,706 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,708 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,710 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,712 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,713 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,715 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,717 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,719 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,721 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,722 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,724 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,726 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,728 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,729 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,731 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,733 copying build/lib/lm_eval/tasks/mmlu_prox/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,735 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,736 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,738 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,740 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,742 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,743 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,745 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,747 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,749 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,751 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,753 copying build/lib/lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,755 copying build/lib/lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/cs 2026-09-01T00:16:27,758 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,759 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,761 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,762 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,764 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,766 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,768 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,769 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,771 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,773 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,775 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,777 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,778 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,780 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,782 copying build/lib/lm_eval/tasks/mmlu_prox/mr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,783 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,785 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,787 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,789 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,790 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,792 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,794 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,795 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,797 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,799 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,801 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,802 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,804 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,806 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,808 copying build/lib/lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,810 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,811 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,813 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,815 copying build/lib/lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/mr 2026-09-01T00:16:27,818 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,819 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,821 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,823 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,825 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,827 copying build/lib/lm_eval/tasks/mmlu_prox/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,828 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,830 copying build/lib/lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,832 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,833 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,835 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,837 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,839 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,840 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,842 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,844 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,845 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,847 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,849 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,851 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,852 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,854 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,856 copying build/lib/lm_eval/tasks/mmlu_prox/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,858 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,860 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,862 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,864 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,865 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,867 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,869 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,871 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,872 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,874 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,876 copying build/lib/lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/es 2026-09-01T00:16:27,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,879 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,881 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,883 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,884 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,886 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,888 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,890 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,892 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,894 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,895 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,897 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,899 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,901 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,902 copying build/lib/lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,904 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,906 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,908 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,910 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,912 copying build/lib/lm_eval/tasks/mmlu_prox/af/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,914 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,916 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,918 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,919 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,921 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,922 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,924 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,926 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,927 copying build/lib/lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,929 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,931 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,932 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,934 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,936 copying build/lib/lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/af 2026-09-01T00:16:27,939 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,940 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,941 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,943 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,945 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,947 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,949 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,951 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,954 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,956 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,959 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,961 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,963 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,965 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,968 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,970 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,972 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,974 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,977 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,979 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,981 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,983 copying build/lib/lm_eval/tasks/mmlu_prox/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,986 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,988 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,990 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,992 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,995 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,997 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:27,999 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:28,001 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:28,004 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:28,006 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:28,009 copying build/lib/lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:28,011 copying build/lib/lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/vi 2026-09-01T00:16:28,015 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,017 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,019 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,022 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,024 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,027 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,029 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,031 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,034 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,036 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,038 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,041 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,043 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,045 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,047 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,049 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,051 copying build/lib/lm_eval/tasks/mmlu_prox/wo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,053 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,055 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,057 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,059 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,061 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,063 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,065 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,066 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,068 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,070 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,072 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,074 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,076 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,078 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,079 copying build/lib/lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,081 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,082 copying build/lib/lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/wo 2026-09-01T00:16:28,084 copying build/lib/lm_eval/tasks/mmlu_prox/lang_libs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:16:28,088 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,089 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,091 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,093 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,095 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,097 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,098 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,101 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,103 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,104 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,106 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,108 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,109 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,111 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,113 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,115 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,116 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,118 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,120 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,121 copying build/lib/lm_eval/tasks/mmlu_prox/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,123 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,125 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,127 copying build/lib/lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,129 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,130 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,132 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,133 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,135 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,137 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,139 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,140 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,142 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,144 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,145 copying build/lib/lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zh 2026-09-01T00:16:28,148 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,149 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,151 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,153 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,154 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,156 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,158 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,160 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,161 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,163 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,165 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,167 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,169 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,171 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,172 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,174 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,176 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,177 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,179 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,181 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,183 copying build/lib/lm_eval/tasks/mmlu_prox/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,184 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,186 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,188 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,190 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,191 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,193 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,195 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,197 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,198 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,200 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,202 copying build/lib/lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,204 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,205 copying build/lib/lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/pt 2026-09-01T00:16:28,208 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/template 2026-09-01T00:16:28,209 copying build/lib/lm_eval/tasks/mmlu_prox/template/_lang_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2026-09-01T00:16:28,210 copying build/lib/lm_eval/tasks/mmlu_prox/template/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/template 2026-09-01T00:16:28,213 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,214 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,216 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,218 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,220 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,221 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,223 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,225 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,226 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,228 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,229 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,231 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,233 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,235 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,236 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,238 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,240 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,242 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,243 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,245 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,247 copying build/lib/lm_eval/tasks/mmlu_prox/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,249 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,250 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,252 copying build/lib/lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,254 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,256 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,257 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,259 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,261 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,262 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,264 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,266 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,267 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,269 copying build/lib/lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/uk 2026-09-01T00:16:28,272 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,273 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,274 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,276 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,278 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,280 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,281 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,283 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,286 copying build/lib/lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,288 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,290 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,292 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,294 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,296 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,298 copying build/lib/lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,299 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,301 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,303 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,305 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,307 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,309 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,310 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,312 copying build/lib/lm_eval/tasks/mmlu_prox/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,314 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,316 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,317 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,319 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,321 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,323 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,325 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,327 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,329 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,330 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,332 copying build/lib/lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/te 2026-09-01T00:16:28,335 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,336 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,338 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,340 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,342 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,344 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,346 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,348 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,349 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,351 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,353 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,355 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,357 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,358 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,360 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,362 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,363 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,365 copying build/lib/lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,367 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,369 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,370 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,372 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,374 copying build/lib/lm_eval/tasks/mmlu_prox/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,376 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,378 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,380 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,382 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,383 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,385 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,387 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,389 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,391 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,392 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,394 copying build/lib/lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/fr 2026-09-01T00:16:28,396 copying build/lib/lm_eval/tasks/mmlu_prox/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:16:28,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,400 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,402 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,404 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,405 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,407 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,409 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,410 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,412 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,414 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,416 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,417 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,419 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,421 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,423 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,424 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,426 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,428 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,430 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,432 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,434 copying build/lib/lm_eval/tasks/mmlu_prox/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,436 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,437 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,439 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,441 copying build/lib/lm_eval/tasks/mmlu_prox/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,443 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,445 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,447 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,448 copying build/lib/lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,450 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,451 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,453 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,455 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,456 copying build/lib/lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/en 2026-09-01T00:16:28,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,460 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,462 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,463 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,465 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,467 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,469 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,471 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,472 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,474 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,476 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,478 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,479 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,481 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,483 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,485 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,486 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,488 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,490 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,492 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,494 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,495 copying build/lib/lm_eval/tasks/mmlu_prox/zu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,497 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,499 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,502 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,504 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,506 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,507 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,509 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,511 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,512 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,514 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,516 copying build/lib/lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,518 copying build/lib/lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/zu 2026-09-01T00:16:28,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,522 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,523 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,525 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,527 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,529 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,530 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,532 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,534 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,536 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,538 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,539 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,541 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,543 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,544 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,546 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,548 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,549 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,551 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,553 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,555 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,556 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,558 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,560 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,562 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,563 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,565 copying build/lib/lm_eval/tasks/mmlu_prox/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,567 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,569 copying build/lib/lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,571 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,572 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,574 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,576 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,578 copying build/lib/lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/bn 2026-09-01T00:16:28,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,582 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,584 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,586 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,587 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,589 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,590 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,592 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,594 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,595 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,597 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,599 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,601 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,602 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,604 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,606 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,608 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,610 copying build/lib/lm_eval/tasks/mmlu_prox/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,611 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,613 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,615 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,617 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,618 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,620 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,622 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,624 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,626 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,628 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,629 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,631 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,633 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,634 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,636 copying build/lib/lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,638 copying build/lib/lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sw 2026-09-01T00:16:28,640 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,641 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,643 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,645 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,647 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,649 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,650 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,652 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,654 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,655 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,657 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,659 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,661 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,662 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,664 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,666 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,668 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,669 copying build/lib/lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,671 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,673 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,674 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,676 copying build/lib/lm_eval/tasks/mmlu_prox/hu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,678 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,679 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,681 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,683 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,684 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,686 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,688 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,689 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,691 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,693 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,694 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,696 copying build/lib/lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/hu 2026-09-01T00:16:28,699 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,700 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,702 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,703 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,705 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,707 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,709 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,711 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,712 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,714 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,716 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,718 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,720 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,721 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,723 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,725 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,727 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,728 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,730 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,732 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,733 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,735 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,737 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,739 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,740 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,742 copying build/lib/lm_eval/tasks/mmlu_prox/ur/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,744 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,746 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,748 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,749 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,751 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,753 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,755 copying build/lib/lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,758 copying build/lib/lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ur 2026-09-01T00:16:28,760 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:16:28,763 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,765 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,767 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,769 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,771 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,773 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,775 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,777 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,779 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,781 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,783 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,785 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,788 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,790 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,792 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,794 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,796 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,799 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,801 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,803 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,806 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,808 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,810 copying build/lib/lm_eval/tasks/mmlu_prox/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,812 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,814 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,817 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,819 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,821 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,823 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,825 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,828 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,829 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,832 copying build/lib/lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,834 copying build/lib/lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/sr 2026-09-01T00:16:28,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,838 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,841 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,843 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,845 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,847 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,849 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,851 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,853 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,855 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,857 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,858 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,860 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,862 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,864 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,865 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,867 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,869 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,871 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,873 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,875 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,876 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,878 copying build/lib/lm_eval/tasks/mmlu_prox/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,880 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,881 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,883 copying build/lib/lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,885 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,886 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,888 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,890 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,892 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,894 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,895 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,897 copying build/lib/lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ko 2026-09-01T00:16:28,900 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,901 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,903 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,905 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,907 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,908 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,910 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,912 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,914 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,916 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,918 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,919 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,921 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,923 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,924 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,926 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,928 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,929 copying build/lib/lm_eval/tasks/mmlu_prox/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,931 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,933 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,935 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,936 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,938 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,940 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,942 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,943 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,945 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,947 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,949 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,951 copying build/lib/lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,952 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,954 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,956 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,958 copying build/lib/lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ne 2026-09-01T00:16:28,961 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,962 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,964 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,966 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,967 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,969 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,970 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,972 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,974 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,975 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,977 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,979 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,980 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,982 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,984 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,986 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,988 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,990 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,991 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,993 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,995 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,997 copying build/lib/lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:28,999 copying build/lib/lm_eval/tasks/mmlu_prox/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,001 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,003 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,004 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,006 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,008 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,010 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,012 copying build/lib/lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,013 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,015 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,017 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,018 copying build/lib/lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/it 2026-09-01T00:16:29,021 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,022 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,024 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,026 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,028 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,029 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,031 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,033 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,035 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,036 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,038 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,040 copying build/lib/lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,042 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,043 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,045 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,047 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,049 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,050 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,052 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,054 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,055 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,057 copying build/lib/lm_eval/tasks/mmlu_prox/th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,059 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,060 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,062 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,064 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,066 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,068 copying build/lib/lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,069 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,071 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,073 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,075 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,076 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,078 copying build/lib/lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/th 2026-09-01T00:16:29,080 copying build/lib/lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox 2026-09-01T00:16:29,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,084 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,086 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,088 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,089 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,091 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,094 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,096 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,098 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,099 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,101 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,103 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,105 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,106 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,108 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,110 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,111 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,113 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,115 copying build/lib/lm_eval/tasks/mmlu_prox/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,116 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,118 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,120 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,122 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,123 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,125 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,127 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,129 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,130 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,132 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,134 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,135 copying build/lib/lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,137 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,139 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,141 copying build/lib/lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_prox/ru 2026-09-01T00:16:29,143 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,144 copying build/lib/lm_eval/tasks/inverse_scaling/_some_results -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,147 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,148 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,150 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,151 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,153 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,155 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,156 copying build/lib/lm_eval/tasks/inverse_scaling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,158 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,160 copying build/lib/lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,162 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,163 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,165 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,167 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2026-09-01T00:16:29,169 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli 2026-09-01T00:16:29,170 copying build/lib/lm_eval/tasks/xnli/xnli_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,172 copying build/lib/lm_eval/tasks/xnli/xnli_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,173 copying build/lib/lm_eval/tasks/xnli/xnli_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,175 copying build/lib/lm_eval/tasks/xnli/xnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,177 copying build/lib/lm_eval/tasks/xnli/xnli_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,179 copying build/lib/lm_eval/tasks/xnli/xnli_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,180 copying build/lib/lm_eval/tasks/xnli/xnli_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,182 copying build/lib/lm_eval/tasks/xnli/xnli_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,184 copying build/lib/lm_eval/tasks/xnli/xnli_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,186 copying build/lib/lm_eval/tasks/xnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,188 copying build/lib/lm_eval/tasks/xnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,190 copying build/lib/lm_eval/tasks/xnli/xnli_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,192 copying build/lib/lm_eval/tasks/xnli/xnli_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,193 copying build/lib/lm_eval/tasks/xnli/xnli_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,195 copying build/lib/lm_eval/tasks/xnli/xnli_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,197 copying build/lib/lm_eval/tasks/xnli/_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,199 copying build/lib/lm_eval/tasks/xnli/xnli_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,200 copying build/lib/lm_eval/tasks/xnli/xnli_bg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,202 copying build/lib/lm_eval/tasks/xnli/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2026-09-01T00:16:29,204 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,205 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,207 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,209 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,211 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,213 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,215 copying build/lib/lm_eval/tasks/tinyBenchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,217 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,219 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,220 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,222 copying build/lib/lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,224 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,226 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,228 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2026-09-01T00:16:29,230 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu 2026-09-01T00:16:29,232 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,233 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,235 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,237 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,239 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,241 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,243 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,244 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,246 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,248 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,250 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,252 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,254 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,256 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,258 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,260 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,262 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,264 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,266 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,268 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,270 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,272 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,274 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,276 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,278 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,280 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,282 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,284 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,286 copying build/lib/lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,288 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,290 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,292 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,294 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,296 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,298 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,300 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,303 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,304 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,307 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,308 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,310 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,312 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,314 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,316 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,318 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,320 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,322 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,324 copying build/lib/lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,325 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,327 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,329 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,331 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2026-09-01T00:16:29,334 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,336 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,339 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,341 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,343 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,346 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,348 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,351 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,353 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,356 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,358 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,361 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,363 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,365 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,368 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,370 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,373 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,375 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,378 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,381 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,383 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,386 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,388 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,392 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,394 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,397 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,400 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,402 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,405 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,407 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,410 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,412 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,413 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,416 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,418 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,420 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,422 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,424 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,427 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,429 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,431 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,433 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,435 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,437 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,440 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,442 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,444 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,447 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,449 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,451 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,453 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,455 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2026-09-01T00:16:29,459 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,460 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,461 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,463 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,465 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,466 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,468 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,470 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,471 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,473 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,475 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,476 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,478 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,480 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,482 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,483 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,485 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,487 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,489 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,490 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,492 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,494 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,496 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,497 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,499 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,501 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,502 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,504 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,505 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,507 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,509 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,510 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,512 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,514 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,515 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,517 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,519 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,521 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,523 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,524 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,526 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,528 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,529 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,531 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,533 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,535 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,537 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,538 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,540 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,541 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,543 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,545 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2026-09-01T00:16:29,547 copying build/lib/lm_eval/tasks/kmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu 2026-09-01T00:16:29,550 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,551 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,553 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,554 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,556 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,558 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,560 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,562 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,563 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,565 copying build/lib/lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,567 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,569 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,570 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,572 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,574 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,576 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,578 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,579 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,581 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,582 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,584 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,586 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,588 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,589 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,591 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,593 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,595 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,596 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,598 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,599 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,601 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,603 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,605 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,607 copying build/lib/lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,608 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,610 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,612 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,613 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,615 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,617 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,619 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,620 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,622 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,624 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,626 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,627 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,629 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,631 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,632 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,634 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,636 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,637 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2026-09-01T00:16:29,640 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,641 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,643 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,645 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,647 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,648 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,650 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,652 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,653 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,655 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,657 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,659 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,660 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,662 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,664 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,666 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,667 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,669 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,671 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,672 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,674 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,676 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,677 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,679 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,681 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,682 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,684 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,686 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,688 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,690 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,691 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,693 copying build/lib/lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,695 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,696 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,698 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,700 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,702 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,703 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,705 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,707 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,709 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,710 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,712 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,713 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,715 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,717 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,718 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,720 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,722 copying build/lib/lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,723 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,725 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,727 copying build/lib/lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/default 2026-09-01T00:16:29,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/meqsum 2026-09-01T00:16:29,730 copying build/lib/lm_eval/tasks/meqsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-09-01T00:16:29,732 copying build/lib/lm_eval/tasks/meqsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-09-01T00:16:29,734 copying build/lib/lm_eval/tasks/meqsum/meqsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/meqsum 2026-09-01T00:16:29,736 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glianorex 2026-09-01T00:16:29,738 copying build/lib/lm_eval/tasks/glianorex/glianorex_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:16:29,739 copying build/lib/lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:16:29,741 copying build/lib/lm_eval/tasks/glianorex/glianorex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:16:29,743 copying build/lib/lm_eval/tasks/glianorex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:16:29,744 copying build/lib/lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2026-09-01T00:16:29,747 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/egyhellaswag 2026-09-01T00:16:29,748 copying build/lib/lm_eval/tasks/egyhellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-09-01T00:16:29,750 copying build/lib/lm_eval/tasks/egyhellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-09-01T00:16:29,751 copying build/lib/lm_eval/tasks/egyhellaswag/egyhellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/egyhellaswag 2026-09-01T00:16:29,754 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swde 2026-09-01T00:16:29,755 copying build/lib/lm_eval/tasks/swde/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-09-01T00:16:29,757 copying build/lib/lm_eval/tasks/swde/swde.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-09-01T00:16:29,759 copying build/lib/lm_eval/tasks/swde/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2026-09-01T00:16:29,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cnn_dailymail 2026-09-01T00:16:29,762 copying build/lib/lm_eval/tasks/cnn_dailymail/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-09-01T00:16:29,764 copying build/lib/lm_eval/tasks/cnn_dailymail/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-09-01T00:16:29,766 copying build/lib/lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cnn_dailymail 2026-09-01T00:16:29,768 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aclue 2026-09-01T00:16:29,769 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,771 copying build/lib/lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,772 copying build/lib/lm_eval/tasks/aclue/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,774 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,776 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,777 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,779 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,781 copying build/lib/lm_eval/tasks/aclue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,783 copying build/lib/lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,784 copying build/lib/lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,786 copying build/lib/lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,788 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,790 copying build/lib/lm_eval/tasks/aclue/_aclue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,791 copying build/lib/lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,793 copying build/lib/lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,795 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,797 copying build/lib/lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,798 copying build/lib/lm_eval/tasks/aclue/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,800 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2026-09-01T00:16:29,802 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:16:29,805 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,806 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,808 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,810 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,811 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,813 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,815 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,817 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,818 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,820 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,822 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,823 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,825 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,827 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,829 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,831 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,833 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,834 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,836 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,838 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,839 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,841 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,843 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,845 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,847 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,848 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,850 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,852 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,854 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,855 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,857 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,859 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,860 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,862 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,864 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,866 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,867 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,869 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,871 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,873 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,874 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,876 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,878 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,880 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,881 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,883 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,885 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,887 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,889 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,890 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,892 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,894 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,896 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,897 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,899 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,901 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,902 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,904 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,906 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,908 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2026-09-01T00:16:29,910 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:16:29,911 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:16:29,913 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:16:29,914 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2026-09-01T00:16:29,917 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,918 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,920 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,921 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,923 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,925 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,927 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,929 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,930 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,932 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,934 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,936 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2026-09-01T00:16:29,939 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,940 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,942 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,943 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,945 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,947 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,949 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,950 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,952 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,954 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,956 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,957 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,959 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,961 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,963 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,965 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,966 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,968 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,970 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,971 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,973 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,975 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,976 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,978 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,980 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,982 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,983 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,985 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,987 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,989 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,991 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,992 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,994 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,996 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:29,998 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,000 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,001 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,003 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,006 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,007 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,009 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,011 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,013 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,014 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,016 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,018 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,020 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,021 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,023 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,025 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,027 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,028 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,030 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,032 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,034 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,035 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,037 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,039 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,041 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,043 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,044 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2026-09-01T00:16:30,046 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:16:30,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:16:30,050 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:16:30,052 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:16:30,053 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2026-09-01T00:16:30,056 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:16:30,057 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:16:30,059 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:16:30,060 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2026-09-01T00:16:30,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:16:30,064 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:16:30,066 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:16:30,068 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2026-09-01T00:16:30,069 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2026-09-01T00:16:30,071 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:16:30,072 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:16:30,074 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:16:30,076 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2026-09-01T00:16:30,078 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:16:30,079 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:16:30,081 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:16:30,082 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2026-09-01T00:16:30,085 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:16:30,086 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:16:30,088 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:16:30,090 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2026-09-01T00:16:30,092 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:16:30,093 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:16:30,095 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:16:30,097 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2026-09-01T00:16:30,099 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:16:30,100 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:16:30,102 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:16:30,104 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2026-09-01T00:16:30,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:16:30,107 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:16:30,109 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:16:30,110 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2026-09-01T00:16:30,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:16:30,113 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:16:30,115 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:16:30,117 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2026-09-01T00:16:30,119 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:16:30,120 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:16:30,122 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:16:30,124 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2026-09-01T00:16:30,127 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada 2026-09-01T00:16:30,128 copying build/lib/lm_eval/tasks/lambada/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-09-01T00:16:30,130 copying build/lib/lm_eval/tasks/lambada/lambada_openai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-09-01T00:16:30,132 copying build/lib/lm_eval/tasks/lambada/lambada_standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2026-09-01T00:16:30,134 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/chartqa 2026-09-01T00:16:30,135 copying build/lib/lm_eval/tasks/chartqa/chartqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:16:30,137 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:16:30,139 copying build/lib/lm_eval/tasks/chartqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:16:30,141 copying build/lib/lm_eval/tasks/chartqa/chartqa_llama_90.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:16:30,143 copying build/lib/lm_eval/tasks/chartqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/chartqa 2026-09-01T00:16:30,145 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:30,146 copying build/lib/lm_eval/tasks/jsonschema_bench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:30,149 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:30,151 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:30,153 copying build/lib/lm_eval/tasks/jsonschema_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:30,155 copying build/lib/lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jsonschema_bench 2026-09-01T00:16:30,157 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/physics_gre 2026-09-01T00:16:30,158 copying build/lib/lm_eval/tasks/physics_gre/physics_gre_additional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:16:30,160 copying build/lib/lm_eval/tasks/physics_gre/_physics_gre_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:16:30,162 copying build/lib/lm_eval/tasks/physics_gre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:16:30,163 copying build/lib/lm_eval/tasks/physics_gre/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:16:30,165 copying build/lib/lm_eval/tasks/physics_gre/physics_gre_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:16:30,167 copying build/lib/lm_eval/tasks/physics_gre/physics_gre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/physics_gre 2026-09-01T00:16:30,169 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/legalbench 2026-09-01T00:16:30,170 copying build/lib/lm_eval/tasks/legalbench/corporate_lobbying.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,172 copying build/lib/lm_eval/tasks/legalbench/contract_nli_notice_on_compelled_disclosure.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,174 copying build/lib/lm_eval/tasks/legalbench/contract_nli_sharing_with_employees.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,176 copying build/lib/lm_eval/tasks/legalbench/_contract_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,178 copying build/lib/lm_eval/tasks/legalbench/contract_nli_explicit_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,180 copying build/lib/lm_eval/tasks/legalbench/contract_nli_limited_use.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,181 copying build/lib/lm_eval/tasks/legalbench/contract_nli_return_of_confidential_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,183 copying build/lib/lm_eval/tasks/legalbench/_legalbench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,185 copying build/lib/lm_eval/tasks/legalbench/contract_nli_survival_of_obligations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,187 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_development_of_similar_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,189 copying build/lib/lm_eval/tasks/legalbench/contract_nli_no_licensing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,190 copying build/lib/lm_eval/tasks/legalbench/international_citizenship_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,192 copying build/lib/lm_eval/tasks/legalbench/contract_nli_sharing_with_third-parties.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,194 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_copy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,195 copying build/lib/lm_eval/tasks/legalbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,197 copying build/lib/lm_eval/tasks/legalbench/_legalbench_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,199 copying build/lib/lm_eval/tasks/legalbench/contract_nli_inclusion_of_verbally_conveyed_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,201 copying build/lib/lm_eval/tasks/legalbench/contract_nli_confidentiality_of_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,202 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_acquirement_of_similar_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,204 copying build/lib/lm_eval/tasks/legalbench/contract_nli_permissible_post-agreement_possession.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,206 copying build/lib/lm_eval/tasks/legalbench/abercrombie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,208 copying build/lib/lm_eval/tasks/legalbench/function_of_decision_section.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,209 copying build/lib/lm_eval/tasks/legalbench/proa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/legalbench 2026-09-01T00:16:30,212 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/slr_bench 2026-09-01T00:16:30,213 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,215 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,216 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,218 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,220 copying build/lib/lm_eval/tasks/slr_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,222 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,224 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,226 copying build/lib/lm_eval/tasks/slr_bench/slr_bench_basic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,228 copying build/lib/lm_eval/tasks/slr_bench/lm_eval_slr_bench.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/slr_bench 2026-09-01T00:16:30,230 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fld 2026-09-01T00:16:30,232 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:16:30,234 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:16:30,236 copying build/lib/lm_eval/tasks/fld/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:16:30,238 copying build/lib/lm_eval/tasks/fld/fld_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:16:30,240 copying build/lib/lm_eval/tasks/fld/fld_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2026-09-01T00:16:30,243 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squad_completion 2026-09-01T00:16:30,244 copying build/lib/lm_eval/tasks/squad_completion/squad_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-09-01T00:16:30,246 copying build/lib/lm_eval/tasks/squad_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-09-01T00:16:30,248 copying build/lib/lm_eval/tasks/squad_completion/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2026-09-01T00:16:30,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/asdiv 2026-09-01T00:16:30,252 copying build/lib/lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-09-01T00:16:30,254 copying build/lib/lm_eval/tasks/asdiv/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-09-01T00:16:30,257 copying build/lib/lm_eval/tasks/asdiv/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2026-09-01T00:16:30,259 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu 2026-09-01T00:16:30,262 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full 2026-09-01T00:16:30,265 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,267 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,269 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,271 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,273 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,275 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,277 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,279 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,281 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,283 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,285 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,287 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,289 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,291 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,292 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,294 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,296 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,297 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,299 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,301 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,302 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,304 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,306 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,307 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,309 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,313 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,315 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,316 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,318 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,320 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,322 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,324 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,326 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,328 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,331 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,334 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,338 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,342 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,347 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,357 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,361 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,365 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,370 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,375 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,380 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,393 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,401 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,410 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,419 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,429 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,439 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,450 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,462 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,474 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,482 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,484 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,486 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,487 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,489 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,491 copying build/lib/lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ms 2026-09-01T00:16:30,496 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,497 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,499 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,502 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,503 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,505 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,507 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,509 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,511 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,512 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,514 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,516 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,518 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,519 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,521 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,523 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,524 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,526 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,528 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,529 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,531 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,532 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,534 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,536 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,537 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,539 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,541 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,542 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,544 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,546 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,547 copying build/lib/lm_eval/tasks/global_mmlu/full/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,549 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,551 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,553 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,555 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,557 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,558 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,560 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,562 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,563 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,565 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,567 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,568 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,570 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,572 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,574 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,576 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,577 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,579 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,581 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,582 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,584 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,589 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,591 copying build/lib/lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,594 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,596 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,598 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,602 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,605 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,607 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,609 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,612 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,614 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,618 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,620 copying build/lib/lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/id 2026-09-01T00:16:30,624 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,625 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,627 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,629 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,631 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,634 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,636 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,638 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,640 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,642 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,644 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,646 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,648 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,650 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,652 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,654 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,656 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,658 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,660 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,662 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,665 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,667 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,669 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,671 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,673 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,675 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,677 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,679 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,681 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,683 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,685 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,687 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,689 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,692 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,694 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,696 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,698 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,700 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,702 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,704 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,706 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,708 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,710 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,712 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,714 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,716 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,718 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,720 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,722 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,724 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,727 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,729 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,731 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,733 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,736 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,738 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,740 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,742 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,744 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,746 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,748 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,750 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,753 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,755 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,757 copying build/lib/lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ar 2026-09-01T00:16:30,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,762 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,765 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,767 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,769 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,771 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,774 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,776 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,778 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,780 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,782 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,784 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,786 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,788 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,790 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,793 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,795 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,797 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,799 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,801 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,803 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,804 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,807 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,809 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,811 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,813 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,815 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,817 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,819 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,821 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,823 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,826 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,828 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,830 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,832 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,834 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,836 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,839 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,841 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,843 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,845 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,847 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,849 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,851 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,853 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,855 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,857 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,859 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,861 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,863 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,865 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,867 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,869 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,871 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,873 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,875 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,877 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,879 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,881 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,883 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,886 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,888 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,890 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,892 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,894 copying build/lib/lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/yo 2026-09-01T00:16:30,898 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,899 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,901 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,904 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,906 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,908 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,910 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,913 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,915 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,918 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,920 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,923 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,925 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,928 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,933 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,936 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,938 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,941 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,943 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,946 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,948 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,950 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,953 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,955 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,957 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,960 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,962 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,965 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,967 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,970 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,973 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,976 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,979 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,982 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,985 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,988 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,990 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,993 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,996 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:30,998 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,001 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,004 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,006 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,009 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,012 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,014 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,017 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,020 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,022 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,025 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,027 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,030 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,033 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,035 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,038 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,041 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,043 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,046 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,049 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,051 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,053 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,056 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,058 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,061 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,063 copying build/lib/lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/hi 2026-09-01T00:16:31,068 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,069 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,071 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,073 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,074 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,076 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,078 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,080 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,082 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,084 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,086 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,087 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,089 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,091 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,093 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,095 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,097 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,099 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,101 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,102 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,104 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,106 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,108 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,109 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,111 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,113 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,115 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,117 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,119 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,120 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,122 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,124 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,126 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,128 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,130 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,131 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,133 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,135 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,137 copying build/lib/lm_eval/tasks/global_mmlu/full/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,139 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,140 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,142 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,144 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,145 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,147 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,149 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,151 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,152 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,154 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,156 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,158 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,159 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,161 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,163 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,164 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,166 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,168 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,170 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,172 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,174 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,176 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,178 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,179 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,181 copying build/lib/lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,183 copying build/lib/lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/de 2026-09-01T00:16:31,186 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,187 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,189 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,191 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,193 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,194 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,196 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,198 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,200 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,201 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,203 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,205 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,207 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,209 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,211 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,212 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,214 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,216 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,218 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,219 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,221 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,223 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,225 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,227 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,229 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,231 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,232 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,234 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,236 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,238 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,240 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,242 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,243 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,245 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,247 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,249 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,251 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,253 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,255 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,258 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,260 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,261 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,263 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,265 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,266 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,268 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,270 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,272 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,273 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,275 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,277 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,279 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,281 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,282 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,284 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,286 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,288 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,290 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,292 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,294 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,296 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,298 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,299 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,301 copying build/lib/lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ja 2026-09-01T00:16:31,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,306 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,307 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,309 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,313 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,314 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,316 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,318 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,320 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,322 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,323 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,325 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,327 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,329 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,331 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,333 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,334 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,336 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,338 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,340 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,342 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,343 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,345 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,347 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,349 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,356 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,357 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,359 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,361 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,363 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,364 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,366 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,368 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,370 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,372 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,374 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,375 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,377 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,379 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,381 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,383 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,384 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,388 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,390 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,392 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,394 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,396 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,397 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,399 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,401 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,403 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,404 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,406 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,408 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,410 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,412 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,414 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,415 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,417 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,419 copying build/lib/lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ig 2026-09-01T00:16:31,422 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,423 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,425 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,426 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,428 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,430 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,431 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,433 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,435 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,437 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,439 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,440 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,442 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,444 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,446 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,447 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,449 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,451 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,453 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,454 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,456 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,458 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,460 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,461 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,463 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,465 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,467 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,468 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,470 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,472 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,474 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,475 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,477 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,479 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,481 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,482 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,484 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,486 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,488 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,489 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,491 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,493 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,494 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,496 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,498 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,499 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,501 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,503 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,504 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,506 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,508 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,510 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,512 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,513 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,515 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,517 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,518 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,520 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,522 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,524 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,526 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,528 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,529 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,531 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,533 copying build/lib/lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/cs 2026-09-01T00:16:31,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,537 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,539 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,541 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,542 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,544 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,546 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,548 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,550 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,551 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,553 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,555 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,557 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,558 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,560 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,562 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,563 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,565 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,567 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,568 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,570 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,572 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,573 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,575 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,577 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,578 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,580 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,582 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,584 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,585 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,587 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,589 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,591 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,592 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_am_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,594 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,596 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,598 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,600 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,602 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,603 copying build/lib/lm_eval/tasks/global_mmlu/full/am/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,605 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,607 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,609 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,610 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,612 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,614 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,616 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,617 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,619 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,621 copying build/lib/lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,623 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,625 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,627 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,628 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,630 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,632 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,634 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,636 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,637 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,639 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,641 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,643 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,645 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,646 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,648 copying build/lib/lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/am 2026-09-01T00:16:31,651 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,652 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,654 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,656 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,658 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,660 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,662 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,663 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,665 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,667 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,669 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,671 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,672 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,674 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,676 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,678 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,680 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,682 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,684 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,685 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,687 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,689 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,691 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,692 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,694 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,696 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,698 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,700 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,702 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,703 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,705 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,707 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,708 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,710 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,712 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,714 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,716 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,717 copying build/lib/lm_eval/tasks/global_mmlu/full/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,719 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,721 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,723 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,724 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,726 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,728 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,729 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,731 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,733 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,734 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,736 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,738 copying build/lib/lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,740 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,742 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,744 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,745 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,747 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,749 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,750 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,752 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,754 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,756 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,758 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,760 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,761 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,763 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,765 copying build/lib/lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/es 2026-09-01T00:16:31,768 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,769 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,771 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,773 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,774 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,776 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,778 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,779 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,781 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,783 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,785 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,787 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_el_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,788 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,790 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,792 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,794 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,796 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,797 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,799 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,801 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,802 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,804 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,806 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,807 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,809 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,811 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,812 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,814 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,816 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,817 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,819 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,821 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,823 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,824 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,826 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,828 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,830 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,831 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,833 copying build/lib/lm_eval/tasks/global_mmlu/full/el/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,835 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,837 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,839 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,840 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,842 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,844 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,845 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,847 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,849 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,851 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,853 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,854 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,856 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,858 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,860 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,861 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,863 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,865 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,867 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,869 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,870 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,872 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,874 copying build/lib/lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,876 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,877 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,879 copying build/lib/lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/el 2026-09-01T00:16:31,882 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,883 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,885 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,887 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,888 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,890 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,892 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,894 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,895 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,897 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,899 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,901 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,902 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,904 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,906 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,908 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,910 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,912 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,914 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,915 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,917 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,918 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,920 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,922 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,923 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,925 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,927 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,929 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,930 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,932 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,934 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,936 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,937 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,939 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,941 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,943 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,944 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,946 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,948 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,950 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,952 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,953 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,955 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,957 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,958 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,960 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,962 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,963 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,965 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,967 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,969 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,970 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,972 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,974 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,976 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,977 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,979 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,981 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,983 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,984 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,986 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,988 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,990 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,992 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,993 copying build/lib/lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/vi 2026-09-01T00:16:31,996 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:31,997 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_so_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:31,999 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,001 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,003 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,005 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,006 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,008 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,010 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,011 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,013 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,015 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,017 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,018 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,020 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,022 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,024 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,026 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,027 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,029 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,030 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,032 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,034 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,036 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,037 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,039 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,040 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,042 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,044 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,045 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,047 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,049 copying build/lib/lm_eval/tasks/global_mmlu/full/so/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,051 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,052 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,054 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,056 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,058 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,060 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,061 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,063 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,065 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,067 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,068 copying build/lib/lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,070 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,071 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,073 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,075 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,076 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,078 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,080 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,081 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,083 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,085 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,087 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,088 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,090 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,092 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,094 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,096 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,098 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,099 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,101 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,103 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,104 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,106 copying build/lib/lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/so 2026-09-01T00:16:32,109 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,110 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,112 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,114 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,115 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,117 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,119 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,121 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,122 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,124 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,126 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,128 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,129 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,131 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,133 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,134 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,136 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,138 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,140 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,141 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,143 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,145 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,146 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,148 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,149 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,151 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,153 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,155 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,156 copying build/lib/lm_eval/tasks/global_mmlu/full/si/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,158 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,160 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,162 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,163 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,165 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,167 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,169 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,170 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,172 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,174 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,176 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,178 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,179 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,181 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,183 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,184 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,186 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,188 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_si_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,189 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,191 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,193 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,195 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,196 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,198 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,200 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,202 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,204 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,205 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,207 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,209 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,211 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,212 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,214 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,216 copying build/lib/lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,218 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,219 copying build/lib/lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/si 2026-09-01T00:16:32,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,223 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,225 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,227 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,229 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,230 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,232 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,234 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,236 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,237 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,239 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,241 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,243 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,244 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,246 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,248 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,249 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,251 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,253 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,255 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,256 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,258 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,260 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,261 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,263 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,265 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,267 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,269 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,270 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,272 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,274 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,276 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,277 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,279 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,281 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,283 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,284 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,286 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,288 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,290 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,291 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,293 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,295 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,297 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,298 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,300 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,302 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,303 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,305 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,307 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,309 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,310 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,312 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,314 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,316 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,317 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,319 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,321 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,322 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,324 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,326 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,328 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,330 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,331 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,333 copying build/lib/lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/zh 2026-09-01T00:16:32,336 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,337 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,339 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,342 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,344 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,346 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,348 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,349 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,351 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,353 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,354 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,356 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,358 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,360 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,361 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,363 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,365 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,367 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,369 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,371 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,372 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,374 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,376 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,377 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,379 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,381 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,383 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,384 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,387 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,389 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,390 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,392 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,394 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,396 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,397 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,399 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,401 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,403 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,404 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,406 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,408 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,410 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,411 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,413 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,415 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,417 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,418 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,420 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,422 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,423 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,425 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,427 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,429 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,430 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,432 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,434 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,436 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,437 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,439 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,441 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,443 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,445 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,446 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,448 copying build/lib/lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ny 2026-09-01T00:16:32,451 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,452 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,454 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,456 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,458 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,459 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,461 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,463 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,464 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,466 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,468 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,470 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,472 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,473 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,475 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,477 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,479 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,480 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,482 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,484 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,486 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,487 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,489 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,491 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,493 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,494 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,496 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,497 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,499 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,501 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,502 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,504 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,506 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,508 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,510 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,512 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,513 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,515 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,517 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,519 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,520 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,522 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,524 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,525 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,527 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,529 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,530 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,532 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,534 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,535 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,537 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,539 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,541 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,543 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,545 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,546 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,548 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,550 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,552 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,554 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,555 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,557 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,559 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,561 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,563 copying build/lib/lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ky 2026-09-01T00:16:32,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,567 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,569 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,570 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,572 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,574 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,575 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,577 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,579 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,581 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,583 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,584 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,586 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,588 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,590 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,592 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,594 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,596 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,598 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,600 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,601 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,603 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,605 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,607 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,608 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,610 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,612 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,614 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,616 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,617 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,619 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,621 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,622 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,624 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,626 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,628 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,630 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,631 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,633 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,635 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,637 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,639 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,640 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,642 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,644 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,645 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,647 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,649 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,651 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,652 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,654 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,656 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,658 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,660 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,661 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,663 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,665 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,667 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,669 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,671 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,673 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,674 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,676 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,678 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,680 copying build/lib/lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fil 2026-09-01T00:16:32,683 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,684 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,686 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,688 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,689 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,691 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,693 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,694 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,696 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,698 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,700 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,702 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,703 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,705 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,707 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,709 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,711 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,713 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,714 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,716 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,718 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,720 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,721 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,723 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,725 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,726 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,728 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,730 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,732 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,734 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,735 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,737 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,739 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,741 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,742 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,744 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,746 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,748 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,750 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,752 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,753 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,755 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,757 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,759 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,760 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,762 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,764 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,766 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,767 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,769 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,771 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,772 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,774 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,776 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,778 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,780 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,782 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,783 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,785 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,787 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,789 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,790 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,792 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,794 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,796 copying build/lib/lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/lt 2026-09-01T00:16:32,799 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,800 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,802 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,804 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,806 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,807 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,809 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,811 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,813 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,815 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,816 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,818 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,820 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,822 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,824 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,825 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,827 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,829 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,831 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,833 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,834 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,836 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,838 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,840 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,841 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,843 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,845 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,847 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,849 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,850 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,852 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,854 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,856 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,858 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,860 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,862 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,864 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,866 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,867 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,869 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,871 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,873 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,874 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,876 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,878 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,880 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,881 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,883 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,885 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,887 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,888 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,890 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,892 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,894 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,896 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,897 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,899 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,901 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,903 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,905 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,907 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,908 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,910 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,912 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,914 copying build/lib/lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pt 2026-09-01T00:16:32,917 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,918 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,920 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,922 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,923 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,925 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,927 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,929 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,930 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,932 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,934 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,936 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,938 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,940 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,941 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,943 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,945 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,947 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,949 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,951 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,953 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,954 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,956 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,958 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,960 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,961 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,963 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,965 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,967 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,969 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,971 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,972 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,974 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,976 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,978 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,980 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,982 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,983 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,985 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,987 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,989 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,991 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,993 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,995 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,997 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:32,998 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,000 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,002 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,004 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,006 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,007 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,009 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,011 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,012 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,014 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,016 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,018 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,020 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,022 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,023 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,025 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,027 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,029 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,031 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,032 copying build/lib/lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/mg 2026-09-01T00:16:33,035 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,036 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,038 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,040 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,041 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,043 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,045 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,047 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,048 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,050 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,051 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,053 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,055 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,057 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,058 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,060 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,062 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,064 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,066 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,068 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,070 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,071 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,073 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,074 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,076 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,078 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,080 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,081 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,083 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,085 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,087 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,088 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,090 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,092 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,094 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,096 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,097 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,099 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,101 copying build/lib/lm_eval/tasks/global_mmlu/full/he/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,103 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,105 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,107 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,108 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,110 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,112 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,113 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,115 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,117 copying build/lib/lm_eval/tasks/global_mmlu/full/he/_he_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,118 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,120 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,122 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,124 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,126 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,127 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,129 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,131 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,133 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,134 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,136 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,138 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,139 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,141 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,143 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,145 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,146 copying build/lib/lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/he 2026-09-01T00:16:33,150 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,151 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,153 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,154 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,156 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,158 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,159 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,161 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,163 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,165 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,166 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,168 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,170 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,172 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,173 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,175 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,177 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,179 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,180 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,183 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,185 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,186 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,188 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,190 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,191 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,193 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,195 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,197 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,198 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,200 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,202 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,204 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,205 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,207 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,209 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,211 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,212 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,214 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,216 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,218 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,220 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,222 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,223 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,225 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,227 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,229 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,230 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,232 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,234 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,235 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,237 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,239 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,240 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,242 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,244 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,246 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,247 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,249 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,251 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,253 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,255 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,256 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,258 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,260 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,262 copying build/lib/lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/uk 2026-09-01T00:16:33,265 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,266 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,268 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,270 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,271 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_te_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,273 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,275 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,276 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,278 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,280 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,281 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,283 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,285 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,287 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,288 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,290 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,292 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,294 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,296 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,298 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,300 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,302 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,304 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,305 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,307 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,309 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,311 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,312 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,314 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,316 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,318 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,320 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,321 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,323 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,325 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,327 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,329 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,331 copying build/lib/lm_eval/tasks/global_mmlu/full/te/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,332 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,334 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,336 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,338 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,340 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,341 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,343 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,345 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,346 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,348 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,350 copying build/lib/lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,351 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,353 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,355 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,357 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,358 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,361 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,363 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,364 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,366 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,368 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,370 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,371 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,373 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,375 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,377 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,379 copying build/lib/lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/te 2026-09-01T00:16:33,382 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,383 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,384 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,386 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,388 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,389 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,391 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,393 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,394 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,396 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,398 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,400 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,401 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,403 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,405 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,407 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,409 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,411 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,412 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,414 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,416 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,418 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,419 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,421 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,423 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,424 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,426 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,428 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,429 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,431 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,433 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,435 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,437 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,438 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,440 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,442 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,444 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,446 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,448 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,450 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,452 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,454 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,456 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,458 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,459 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,461 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,463 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,465 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,466 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,468 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,470 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,472 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,474 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,475 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,477 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,479 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,481 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,483 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,484 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,486 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,488 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,490 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,491 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,493 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,495 copying build/lib/lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fr 2026-09-01T00:16:33,499 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,499 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,502 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,503 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,505 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,507 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,508 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,510 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,512 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,514 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,515 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,517 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,519 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,521 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,523 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,525 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,527 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,529 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,530 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,532 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,534 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,536 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,538 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,540 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,542 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,544 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,545 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,547 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,549 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,550 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,552 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,554 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,556 copying build/lib/lm_eval/tasks/global_mmlu/full/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,558 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,560 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,562 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,563 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,565 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,567 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,569 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,571 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,573 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,574 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,577 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,578 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,580 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,582 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,584 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,585 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,587 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,589 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,591 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,593 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,594 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,596 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,598 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,600 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,602 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,604 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,605 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,607 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,609 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,611 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,613 copying build/lib/lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,615 copying build/lib/lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/en 2026-09-01T00:16:33,618 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,619 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,621 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,623 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,625 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,627 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,628 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,630 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,632 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,634 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,635 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,637 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,639 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,641 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,643 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,644 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,646 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,648 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,650 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,652 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,654 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,655 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,657 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,659 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,661 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,662 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,664 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,666 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,668 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,669 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,671 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,673 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,675 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,677 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,678 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,680 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,682 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,684 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,686 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,688 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,690 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,691 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,693 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,695 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,697 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,698 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,700 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,702 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,704 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,705 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,707 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,709 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,711 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,713 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,714 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,716 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,718 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,720 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,722 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,724 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,726 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,728 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,729 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,731 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,733 copying build/lib/lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/bn 2026-09-01T00:16:33,737 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,738 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,739 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,741 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,743 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,745 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,747 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,749 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,750 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,752 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,754 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,756 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,758 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,760 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,762 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,764 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,766 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,767 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,769 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,771 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,773 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,775 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,777 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,779 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,781 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,783 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,784 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,786 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,788 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,790 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,792 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,794 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,796 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,798 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,799 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,801 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,803 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,805 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,807 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,809 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,811 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,813 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,815 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,817 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,818 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,820 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,822 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,824 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,825 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,827 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,829 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,831 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,833 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,834 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,836 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,838 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,840 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,842 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,844 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,846 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,848 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,849 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,851 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,853 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,855 copying build/lib/lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/fa 2026-09-01T00:16:33,859 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,860 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,861 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,863 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,865 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,867 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,868 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,870 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,872 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,874 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,876 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,878 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,880 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,882 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,884 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,885 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,887 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,889 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,891 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,893 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,895 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,897 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,899 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,901 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,902 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,904 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,906 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,908 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,910 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,911 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,915 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,916 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,918 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,920 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,922 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,924 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,926 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,927 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,929 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,931 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,933 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,935 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,937 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,939 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,941 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,942 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,944 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,946 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,948 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,949 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,951 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,953 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,954 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,956 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,958 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,960 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,961 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,963 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,965 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,967 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,969 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,971 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,972 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,974 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,976 copying build/lib/lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sw 2026-09-01T00:16:33,980 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,981 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,983 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,985 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,986 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,988 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,990 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,992 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,993 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,995 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,997 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:33,999 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,001 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,003 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,004 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,006 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,008 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,010 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,012 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,014 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,016 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,018 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,020 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,022 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,023 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,025 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,027 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,029 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,031 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,033 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,035 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,037 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,039 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,040 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,042 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,044 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,046 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,048 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,050 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,052 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,054 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,056 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,057 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,059 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,061 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,063 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,065 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,066 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,068 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,070 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,072 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,073 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,075 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,077 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,079 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,081 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,082 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,084 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,086 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,088 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,090 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,092 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,094 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,096 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,098 copying build/lib/lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sr 2026-09-01T00:16:34,102 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,103 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,105 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,107 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,109 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,111 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,113 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,115 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,116 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,118 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,120 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,122 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,124 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,126 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,128 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,129 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,131 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,133 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,136 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,138 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,140 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,142 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,144 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,146 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,148 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,150 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,152 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,154 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,156 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,158 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,160 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,162 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,164 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,166 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,168 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,170 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,172 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,173 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,175 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,177 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,179 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,181 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,183 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,185 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,187 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,188 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,190 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,192 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,194 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,196 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,197 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,199 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,201 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,203 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,205 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,207 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,208 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,210 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,212 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,214 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,216 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,218 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,220 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,222 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,224 copying build/lib/lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sn 2026-09-01T00:16:34,227 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,228 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,230 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,232 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,234 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,236 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,238 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,239 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,241 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,243 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,244 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,246 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,248 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,250 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,252 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,254 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,256 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,257 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,259 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,261 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,263 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,265 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,267 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,269 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,271 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,273 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,274 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,276 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,278 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,279 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,281 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,283 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,284 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,286 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,289 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,290 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,292 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,294 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,295 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,297 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,299 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,301 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,302 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,304 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,306 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,308 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,310 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,311 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,313 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,315 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,316 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,318 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,320 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,322 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,323 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,325 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,327 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,329 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,331 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,332 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,334 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,336 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,338 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,340 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ha 2026-09-01T00:16:34,345 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,346 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,348 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,350 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,352 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,353 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,355 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,357 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,359 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,361 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,362 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,364 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,366 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,368 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,369 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,371 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,373 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,375 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,377 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,379 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,381 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,383 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,385 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,387 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,389 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,391 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,392 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,394 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,396 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,398 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,400 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,402 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,403 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,405 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,407 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,409 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,411 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,413 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,415 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,417 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,419 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,420 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,422 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,425 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,427 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,428 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,430 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,432 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,434 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,436 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,438 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,440 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,442 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,444 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,446 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,448 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,450 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,452 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,454 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,455 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,458 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,459 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,461 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,463 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,465 copying build/lib/lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/nl 2026-09-01T00:16:34,469 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,470 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,472 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,474 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,475 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,477 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,479 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,481 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,483 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,484 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,487 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,489 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,490 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,492 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,494 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,496 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,498 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,500 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,502 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,504 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,505 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,507 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,509 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,511 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,513 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,515 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,517 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,519 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,520 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,522 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,524 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,526 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,528 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,529 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,531 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,533 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,535 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,537 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,538 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,540 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,542 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,544 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,546 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,547 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,549 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,551 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,553 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,554 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,556 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,558 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,560 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,562 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,564 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,565 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,567 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,569 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,570 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,572 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,574 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,576 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,578 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,580 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,581 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,583 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,585 copying build/lib/lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ko 2026-09-01T00:16:34,588 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,590 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,592 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,593 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,595 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,597 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,599 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,600 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,602 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,604 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,606 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,608 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,610 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,612 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,614 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,616 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,618 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,620 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,621 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,623 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,625 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,627 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,629 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,630 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,632 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,634 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,636 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,638 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,640 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,641 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,643 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,645 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,647 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,649 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,650 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,652 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,654 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,656 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,658 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,660 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,662 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,664 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,666 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,668 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,669 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,671 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,673 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,675 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,677 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,679 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,680 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,682 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,684 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,685 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,687 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,689 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,691 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,692 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,694 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,696 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,698 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,699 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,701 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,703 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,705 copying build/lib/lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/sv 2026-09-01T00:16:34,708 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,709 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,711 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,713 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,715 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,717 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,718 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,720 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,722 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,724 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,725 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,727 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,729 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,731 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,732 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,734 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,736 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,738 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,740 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,742 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,744 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,745 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,747 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,749 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,751 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,753 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,755 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,757 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,759 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,760 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,762 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,764 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,766 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,768 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,770 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,771 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,773 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,775 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,777 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,779 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,781 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,783 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,785 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,787 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,789 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,791 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,793 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,795 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,797 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,799 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,801 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,802 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,804 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,806 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,808 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,810 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,812 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,814 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,815 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,817 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,819 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,821 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,822 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,824 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,826 copying build/lib/lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ne 2026-09-01T00:16:34,830 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,831 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,833 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,835 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,837 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,839 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,841 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,843 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,844 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,846 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,848 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,850 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,852 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,854 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,856 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,858 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,859 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,861 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,863 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,865 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,867 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,869 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,871 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,873 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,875 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,877 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,878 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,880 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,882 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,884 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,886 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,887 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,889 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,891 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,893 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,895 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,897 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,898 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,900 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,902 copying build/lib/lm_eval/tasks/global_mmlu/full/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,904 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,906 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,908 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,910 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,912 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,914 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,916 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,918 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,919 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,921 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,923 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,925 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,926 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,928 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,930 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,932 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,934 copying build/lib/lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,936 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,938 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,939 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,941 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,943 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,945 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,947 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,949 copying build/lib/lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/it 2026-09-01T00:16:34,952 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,954 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,956 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,958 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,959 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,961 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,963 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,965 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,967 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,969 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,971 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,973 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,975 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,977 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,979 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,981 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,982 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,984 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,986 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,988 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,990 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,992 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,994 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,996 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,997 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:34,999 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,001 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,003 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,005 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,006 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,008 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,010 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,011 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,013 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,015 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,017 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,018 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,020 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,021 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,023 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,025 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,027 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,029 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,031 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,032 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,034 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,036 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,038 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,040 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,042 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,043 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,045 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,047 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,049 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,051 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,053 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,055 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,056 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,058 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,060 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,062 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,063 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,065 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,067 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,069 copying build/lib/lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/pl 2026-09-01T00:16:35,072 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,073 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,075 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,077 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,079 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,081 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,083 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,084 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,086 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,088 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,090 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,091 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,093 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,095 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,097 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,098 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,100 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,102 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,104 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,106 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,108 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,110 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,112 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,113 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,115 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,117 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,119 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,121 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,122 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,124 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,126 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,128 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,130 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,131 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,133 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,135 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,137 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,139 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,141 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,143 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,145 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,147 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,148 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,150 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,152 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,154 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,156 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,158 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,160 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,162 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,163 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,165 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,167 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,169 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,171 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,173 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,174 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,176 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,178 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,180 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,182 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,183 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,185 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,187 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,189 copying build/lib/lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ru 2026-09-01T00:16:35,193 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,194 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,196 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,199 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,201 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,202 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,204 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,206 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,208 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,210 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,211 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,213 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,215 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,217 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,219 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,220 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,222 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,224 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,226 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,228 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,230 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,232 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,234 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,236 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,237 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,239 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,241 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,243 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,245 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,246 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,248 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,250 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,252 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,254 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,256 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,258 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,260 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,262 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,265 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,267 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,269 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,270 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,272 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,274 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,276 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,278 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,280 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,282 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,283 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,285 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,287 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,289 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,290 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,292 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,294 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,296 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,297 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,299 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,301 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,303 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,306 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,308 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,310 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,312 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,314 copying build/lib/lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/tr 2026-09-01T00:16:35,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,319 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,321 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,323 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,325 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,327 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,329 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,331 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,332 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,334 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,336 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,338 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,340 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,341 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,343 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,345 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,347 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,348 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,350 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,352 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,353 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,355 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,357 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,359 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,361 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,363 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,365 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,367 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,369 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,370 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,372 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,374 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,376 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,378 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,380 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,382 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,384 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,386 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,388 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,390 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,392 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,394 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,396 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,397 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,399 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,401 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,403 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,405 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,407 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,408 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,410 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,412 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,414 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,416 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,417 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,419 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,421 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,422 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,424 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,426 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,428 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,430 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,432 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,433 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,435 copying build/lib/lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/full/ro 2026-09-01T00:16:35,438 copying build/lib/lm_eval/tasks/global_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu 2026-09-01T00:16:35,440 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default 2026-09-01T00:16:35,442 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,443 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,445 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_id_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,447 copying build/lib/lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,449 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,451 copying build/lib/lm_eval/tasks/global_mmlu/default/id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,452 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,454 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,456 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,457 copying build/lib/lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/id 2026-09-01T00:16:35,460 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,461 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,463 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,465 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,467 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,469 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,470 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,473 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,474 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,476 copying build/lib/lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ar 2026-09-01T00:16:35,479 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,480 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,482 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,483 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,485 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,487 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,489 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,491 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,493 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,495 copying build/lib/lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/yo 2026-09-01T00:16:35,497 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,498 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,500 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,502 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,504 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,505 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,507 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,509 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,511 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,512 copying build/lib/lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/hi 2026-09-01T00:16:35,515 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,516 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,518 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,520 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,521 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,523 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_de_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,525 copying build/lib/lm_eval/tasks/global_mmlu/default/de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,527 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,529 copying build/lib/lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,531 copying build/lib/lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/de 2026-09-01T00:16:35,533 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,534 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,536 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,538 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,539 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,541 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,543 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,544 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,546 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,548 copying build/lib/lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ja 2026-09-01T00:16:35,550 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,551 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,553 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,555 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_es_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,557 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,558 copying build/lib/lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,560 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,562 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,564 copying build/lib/lm_eval/tasks/global_mmlu/default/es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,566 copying build/lib/lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/es 2026-09-01T00:16:35,568 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,569 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,571 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,573 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,575 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,577 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,578 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,580 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,581 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,583 copying build/lib/lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/zh 2026-09-01T00:16:35,585 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,586 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,588 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,590 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,592 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,594 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,595 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,597 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,599 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,600 copying build/lib/lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/pt 2026-09-01T00:16:35,603 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,604 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,606 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,608 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,609 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,611 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,613 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,615 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,617 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,619 copying build/lib/lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/fr 2026-09-01T00:16:35,621 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,622 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,624 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,625 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,627 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,629 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,631 copying build/lib/lm_eval/tasks/global_mmlu/default/en/_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,632 copying build/lib/lm_eval/tasks/global_mmlu/default/en/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,634 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,635 copying build/lib/lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/en 2026-09-01T00:16:35,638 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,639 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,641 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,642 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,644 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,646 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,648 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,650 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,651 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,653 copying build/lib/lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/bn 2026-09-01T00:16:35,656 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,657 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,658 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,660 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,662 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,663 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,665 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,667 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,668 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,670 copying build/lib/lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/sw 2026-09-01T00:16:35,672 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,673 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,675 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,677 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,678 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,680 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,682 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,683 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,685 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,687 copying build/lib/lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/ko 2026-09-01T00:16:35,690 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,691 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,693 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,694 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_it_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,696 copying build/lib/lm_eval/tasks/global_mmlu/default/it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,698 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,700 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,702 copying build/lib/lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,703 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,705 copying build/lib/lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_mmlu/default/it 2026-09-01T00:16:35,708 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench2 2026-09-01T00:16:35,709 copying build/lib/lm_eval/tasks/longbench2/news_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,711 copying build/lib/lm_eval/tasks/longbench2/translate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,713 copying build/lib/lm_eval/tasks/longbench2/graph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,715 copying build/lib/lm_eval/tasks/longbench2/_longbench2_structured.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,716 copying build/lib/lm_eval/tasks/longbench2/longbench2_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,718 copying build/lib/lm_eval/tasks/longbench2/_longbench2_incontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,720 copying build/lib/lm_eval/tasks/longbench2/agent_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,722 copying build/lib/lm_eval/tasks/longbench2/detective.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,723 copying build/lib/lm_eval/tasks/longbench2/_longbench2_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,725 copying build/lib/lm_eval/tasks/longbench2/govt_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,727 copying build/lib/lm_eval/tasks/longbench2/legal_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,728 copying build/lib/lm_eval/tasks/longbench2/table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,730 copying build/lib/lm_eval/tasks/longbench2/_longbench_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,732 copying build/lib/lm_eval/tasks/longbench2/_longbench2_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,733 copying build/lib/lm_eval/tasks/longbench2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,736 copying build/lib/lm_eval/tasks/longbench2/dialogue_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,737 copying build/lib/lm_eval/tasks/longbench2/fin_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,739 copying build/lib/lm_eval/tasks/longbench2/lit_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,741 copying build/lib/lm_eval/tasks/longbench2/govt_single_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,743 copying build/lib/lm_eval/tasks/longbench2/many_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,745 copying build/lib/lm_eval/tasks/longbench2/_longbench2_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,747 copying build/lib/lm_eval/tasks/longbench2/event_order.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,748 copying build/lib/lm_eval/tasks/longbench2/fin_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,750 copying build/lib/lm_eval/tasks/longbench2/legal_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,752 copying build/lib/lm_eval/tasks/longbench2/academic_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,753 copying build/lib/lm_eval/tasks/longbench2/user_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,755 copying build/lib/lm_eval/tasks/longbench2/_longbench2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,757 copying build/lib/lm_eval/tasks/longbench2/academic_multi_doc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench2 2026-09-01T00:16:35,759 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,760 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,762 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,764 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,766 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,767 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,769 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,771 copying build/lib/lm_eval/tasks/japanese_leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,774 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,776 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,778 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,779 copying build/lib/lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,781 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,783 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,785 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,787 copying build/lib/lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2026-09-01T00:16:35,789 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench 2026-09-01T00:16:35,790 copying build/lib/lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,792 copying build/lib/lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,794 copying build/lib/lm_eval/tasks/basque_bench/paws_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,796 copying build/lib/lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,797 copying build/lib/lm_eval/tasks/basque_bench/basque_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,799 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,800 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,802 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,804 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,805 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,807 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,809 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,811 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,813 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,814 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,817 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,819 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,820 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,822 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,824 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,826 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,828 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,829 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,831 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,833 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2026-09-01T00:16:35,836 copying build/lib/lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,838 copying build/lib/lm_eval/tasks/basque_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,840 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,842 copying build/lib/lm_eval/tasks/basque_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,844 copying build/lib/lm_eval/tasks/basque_bench/arc_eu_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,846 copying build/lib/lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2026-09-01T00:16:35,849 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/french_bench 2026-09-01T00:16:35,850 copying build/lib/lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,852 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,854 copying build/lib/lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,855 copying build/lib/lm_eval/tasks/french_bench/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,857 copying build/lib/lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,859 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,861 copying build/lib/lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,863 copying build/lib/lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,865 copying build/lib/lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,867 copying build/lib/lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,868 copying build/lib/lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,870 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,872 copying build/lib/lm_eval/tasks/french_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,874 copying build/lib/lm_eval/tasks/french_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,876 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,878 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,880 copying build/lib/lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,882 copying build/lib/lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,884 copying build/lib/lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,886 copying build/lib/lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,888 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,890 copying build/lib/lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2026-09-01T00:16:35,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijammlu 2026-09-01T00:16:35,894 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,896 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,898 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,899 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,901 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,903 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,905 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,906 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,908 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,910 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,912 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,914 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,916 copying build/lib/lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,918 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,920 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,922 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,923 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,925 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,927 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,929 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,931 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,933 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,935 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,937 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,939 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,941 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,943 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,944 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,946 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,948 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,950 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,952 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,954 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,956 copying build/lib/lm_eval/tasks/darijammlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,958 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,959 copying build/lib/lm_eval/tasks/darijammlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,961 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,962 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,964 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,966 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,968 copying build/lib/lm_eval/tasks/darijammlu/_darijammlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,970 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,972 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,974 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,976 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,978 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,979 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,981 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,983 copying build/lib/lm_eval/tasks/darijammlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,985 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,987 copying build/lib/lm_eval/tasks/darijammlu/darijammlu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijammlu 2026-09-01T00:16:35,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kormedmcqa 2026-09-01T00:16:35,990 copying build/lib/lm_eval/tasks/kormedmcqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:35,992 copying build/lib/lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:35,994 copying build/lib/lm_eval/tasks/kormedmcqa/pharm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:35,996 copying build/lib/lm_eval/tasks/kormedmcqa/doctor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:35,998 copying build/lib/lm_eval/tasks/kormedmcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:36,000 copying build/lib/lm_eval/tasks/kormedmcqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:36,001 copying build/lib/lm_eval/tasks/kormedmcqa/dentist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:36,003 copying build/lib/lm_eval/tasks/kormedmcqa/nurse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2026-09-01T00:16:36,006 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cmmlu 2026-09-01T00:16:36,007 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,009 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,011 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,013 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,015 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,017 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,018 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,020 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,022 copying build/lib/lm_eval/tasks/cmmlu/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,024 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,026 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,028 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,030 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,032 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,033 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,035 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,037 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,039 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,041 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,043 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,045 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,046 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,048 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,050 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,052 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,053 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,055 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,057 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,059 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,061 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,063 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,065 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,067 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,069 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,071 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,072 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,074 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,076 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,078 copying build/lib/lm_eval/tasks/cmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,080 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,082 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,084 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,086 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,088 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,090 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,092 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,094 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,096 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,097 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,099 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,101 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,103 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,104 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,106 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,108 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,110 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,112 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,114 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,115 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,117 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,119 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,121 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,123 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,125 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,127 copying build/lib/lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,129 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,130 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,132 copying build/lib/lm_eval/tasks/cmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,135 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,137 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,138 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2026-09-01T00:16:36,141 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmmu 2026-09-01T00:16:36,142 copying build/lib/lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,145 copying build/lib/lm_eval/tasks/mmmu/_art_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,147 copying build/lib/lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,148 copying build/lib/lm_eval/tasks/mmmu/mmmu_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,150 copying build/lib/lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,152 copying build/lib/lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,154 copying build/lib/lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,155 copying build/lib/lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,157 copying build/lib/lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,159 copying build/lib/lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,161 copying build/lib/lm_eval/tasks/mmmu/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,163 copying build/lib/lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,165 copying build/lib/lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,167 copying build/lib/lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,169 copying build/lib/lm_eval/tasks/mmmu/mmmu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,171 copying build/lib/lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,173 copying build/lib/lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,175 copying build/lib/lm_eval/tasks/mmmu/_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,177 copying build/lib/lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,179 copying build/lib/lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,181 copying build/lib/lm_eval/tasks/mmmu/mmmu_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,182 copying build/lib/lm_eval/tasks/mmmu/_mmmu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,184 copying build/lib/lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,186 copying build/lib/lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,188 copying build/lib/lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,190 copying build/lib/lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,192 copying build/lib/lm_eval/tasks/mmmu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,194 copying build/lib/lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,196 copying build/lib/lm_eval/tasks/mmmu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,198 copying build/lib/lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,200 copying build/lib/lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,202 copying build/lib/lm_eval/tasks/mmmu/mmmu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,204 copying build/lib/lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,206 copying build/lib/lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,208 copying build/lib/lm_eval/tasks/mmmu/mmmu_art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,210 copying build/lib/lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,212 copying build/lib/lm_eval/tasks/mmmu/_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,214 copying build/lib/lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,216 copying build/lib/lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,218 copying build/lib/lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2026-09-01T00:16:36,220 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_trivia 2026-09-01T00:16:36,221 copying build/lib/lm_eval/tasks/eus_trivia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-09-01T00:16:36,223 copying build/lib/lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-09-01T00:16:36,225 copying build/lib/lm_eval/tasks/eus_trivia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2026-09-01T00:16:36,227 copying build/lib/lm_eval/tasks/_index.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:16:36,230 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include 2026-09-01T00:16:36,232 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en 2026-09-01T00:16:36,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,235 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,238 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,239 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,241 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,243 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,245 copying build/lib/lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Ukrainian 2026-09-01T00:16:36,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,249 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,252 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,254 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,256 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,258 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,260 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,262 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,264 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,266 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,267 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,270 copying build/lib/lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hindi 2026-09-01T00:16:36,272 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,274 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,276 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,278 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,280 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,282 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,283 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,286 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,288 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,290 copying build/lib/lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Azerbaijani 2026-09-01T00:16:36,292 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,293 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,296 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,298 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,300 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,302 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,304 copying build/lib/lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hungarian 2026-09-01T00:16:36,306 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,307 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,309 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,311 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,313 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,315 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,317 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,318 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,320 copying build/lib/lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Dutch 2026-09-01T00:16:36,323 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,324 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,326 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,328 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,330 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,332 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,334 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,336 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,338 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,340 copying build/lib/lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Arabic 2026-09-01T00:16:36,342 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,343 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,346 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,347 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,349 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,351 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,353 copying build/lib/lm_eval/tasks/include/few_shot_en/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,354 copying build/lib/lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,356 copying build/lib/lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/French 2026-09-01T00:16:36,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:36,360 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:36,362 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:36,364 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:36,366 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:36,368 copying build/lib/lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Nepali 2026-09-01T00:16:36,370 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,371 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,374 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,376 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,378 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,380 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,381 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,383 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,385 copying build/lib/lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Estonian 2026-09-01T00:16:36,387 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,388 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,390 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,392 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,394 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,396 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,398 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,400 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,402 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,404 copying build/lib/lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Portuguese 2026-09-01T00:16:36,406 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:36,407 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:36,409 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:36,411 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:36,413 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:36,415 copying build/lib/lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Hebrew 2026-09-01T00:16:36,418 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,419 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,421 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,423 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,425 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,427 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,429 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,431 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,433 copying build/lib/lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Finnish 2026-09-01T00:16:36,435 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,436 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,438 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,440 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,442 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,444 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,446 copying build/lib/lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Japanese 2026-09-01T00:16:36,448 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,449 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,452 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,454 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,456 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,458 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,460 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,462 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,464 copying build/lib/lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Indonesian 2026-09-01T00:16:36,466 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,467 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,469 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,471 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,473 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,475 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,477 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,479 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,481 copying build/lib/lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Lithuanian 2026-09-01T00:16:36,483 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,484 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,486 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,488 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,490 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,492 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,494 copying build/lib/lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bulgarian 2026-09-01T00:16:36,496 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:36,497 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:36,499 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:36,501 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:36,503 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:36,505 copying build/lib/lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tamil 2026-09-01T00:16:36,507 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,508 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,510 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,512 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,514 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,516 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,518 copying build/lib/lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Belarusian 2026-09-01T00:16:36,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,522 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,524 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,526 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,527 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,529 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,531 copying build/lib/lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Serbian 2026-09-01T00:16:36,533 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,535 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,537 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,539 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,541 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,543 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,545 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,547 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,548 copying build/lib/lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Albanian 2026-09-01T00:16:36,551 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,552 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,554 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,556 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,557 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,559 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,560 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,562 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,564 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,566 copying build/lib/lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Italian 2026-09-01T00:16:36,568 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,569 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,571 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,573 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,574 copying build/lib/lm_eval/tasks/include/few_shot_en/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,576 copying build/lib/lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,578 copying build/lib/lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/German 2026-09-01T00:16:36,581 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,582 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,584 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,586 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,588 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,590 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,591 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,593 copying build/lib/lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Telugu 2026-09-01T00:16:36,596 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,597 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,599 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,601 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,603 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,605 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,606 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,608 copying build/lib/lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Bengali 2026-09-01T00:16:36,611 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,612 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,614 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,616 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,618 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_north_macedonian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,620 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,622 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north_macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,624 copying build/lib/lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/North Macedonian 2026-09-01T00:16:36,626 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,627 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,630 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,631 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,633 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,635 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,637 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,639 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,640 copying build/lib/lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Persian 2026-09-01T00:16:36,642 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,644 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,645 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,647 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,649 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,651 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,652 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,654 copying build/lib/lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Armenian 2026-09-01T00:16:36,657 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:16:36,658 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:16:36,660 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:16:36,661 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:16:36,663 copying build/lib/lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Basque 2026-09-01T00:16:36,666 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,667 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,669 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,671 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,672 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,674 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,677 copying build/lib/lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Vietnamese 2026-09-01T00:16:36,679 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,680 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,682 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,684 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,686 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,688 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,690 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,692 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,694 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,696 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,698 copying build/lib/lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Greek 2026-09-01T00:16:36,701 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,702 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,704 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,706 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,708 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,710 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,712 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,713 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,715 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,717 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,719 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,721 copying build/lib/lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Chinese 2026-09-01T00:16:36,723 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,725 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,727 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,728 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,730 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,732 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,734 copying build/lib/lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Polish 2026-09-01T00:16:36,737 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,738 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,740 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,742 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,744 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,746 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,748 copying build/lib/lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Urdu 2026-09-01T00:16:36,751 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,752 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,754 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,756 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,757 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,759 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,761 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,763 copying build/lib/lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Spanish 2026-09-01T00:16:36,765 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,766 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,768 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,770 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,772 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,774 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,776 copying build/lib/lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malay 2026-09-01T00:16:36,778 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,779 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,782 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,784 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,786 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,788 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,789 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,791 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,793 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,795 copying build/lib/lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Malayalam 2026-09-01T00:16:36,797 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,798 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,800 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,802 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,804 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,806 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,808 copying build/lib/lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Croatian 2026-09-01T00:16:36,810 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,811 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,813 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,815 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,817 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,819 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,821 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,823 copying build/lib/lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Turkish 2026-09-01T00:16:36,826 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:36,827 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:36,829 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:36,830 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:36,832 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:36,834 copying build/lib/lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Korean 2026-09-01T00:16:36,836 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:16:36,837 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:16:36,839 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:16:36,841 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:16:36,843 copying build/lib/lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Georgian 2026-09-01T00:16:36,846 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:16:36,847 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:16:36,849 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:16:36,851 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:16:36,853 copying build/lib/lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Kazakh 2026-09-01T00:16:36,855 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:36,856 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:36,858 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:36,860 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:36,862 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:36,863 copying build/lib/lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Tagalog 2026-09-01T00:16:36,866 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,867 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,869 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,871 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,872 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,874 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,876 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,877 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,879 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,881 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,883 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,884 copying build/lib/lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Russian 2026-09-01T00:16:36,887 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,888 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,890 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,892 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,894 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,896 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,898 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,900 copying build/lib/lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_en/Uzbek 2026-09-01T00:16:36,902 copying build/lib/lm_eval/tasks/include/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include 2026-09-01T00:16:36,905 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og 2026-09-01T00:16:36,907 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,908 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,910 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,912 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,914 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,916 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,918 copying build/lib/lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Ukrainian 2026-09-01T00:16:36,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,922 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,924 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,926 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,928 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,929 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,931 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,933 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,935 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,937 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,939 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,941 copying build/lib/lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hindi 2026-09-01T00:16:36,944 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,945 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,947 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,949 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,951 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,953 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,955 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,957 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,958 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,960 copying build/lib/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Azerbaijani 2026-09-01T00:16:36,963 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,964 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,966 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,968 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,970 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,972 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,974 copying build/lib/lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hungarian 2026-09-01T00:16:36,977 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,978 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,980 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,982 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,984 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,986 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,988 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,989 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,991 copying build/lib/lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Dutch 2026-09-01T00:16:36,994 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:36,995 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:36,997 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:36,999 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,001 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,003 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,004 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,006 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,008 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,010 copying build/lib/lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Arabic 2026-09-01T00:16:37,013 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,014 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,016 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,018 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,020 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,022 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,024 copying build/lib/lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,026 copying build/lib/lm_eval/tasks/include/few_shot_og/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,028 copying build/lib/lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/French 2026-09-01T00:16:37,030 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:37,032 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:37,034 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:37,036 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:37,037 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:37,039 copying build/lib/lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Nepali 2026-09-01T00:16:37,042 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,043 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,045 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,047 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,049 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,051 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,053 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,055 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,057 copying build/lib/lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Estonian 2026-09-01T00:16:37,059 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,060 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,062 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,064 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,066 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,068 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,070 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,072 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,074 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,076 copying build/lib/lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Portuguese 2026-09-01T00:16:37,079 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:37,080 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:37,082 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:37,083 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:37,085 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:37,087 copying build/lib/lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Hebrew 2026-09-01T00:16:37,089 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,091 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,093 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,094 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,096 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,098 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,100 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,102 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,103 copying build/lib/lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Finnish 2026-09-01T00:16:37,106 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,107 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,109 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,111 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,113 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,115 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,117 copying build/lib/lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Japanese 2026-09-01T00:16:37,120 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,121 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,123 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,124 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,126 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,128 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,130 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,131 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,133 copying build/lib/lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Indonesian 2026-09-01T00:16:37,136 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,137 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,139 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,141 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,143 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,145 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,147 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,149 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,151 copying build/lib/lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Lithuanian 2026-09-01T00:16:37,153 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,155 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,157 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,158 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,160 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,162 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,164 copying build/lib/lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bulgarian 2026-09-01T00:16:37,166 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:37,167 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:37,170 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:37,171 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:37,173 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:37,175 copying build/lib/lm_eval/tasks/include/few_shot_og/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tamil 2026-09-01T00:16:37,178 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,179 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,181 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,183 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,185 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,187 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,189 copying build/lib/lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Belarusian 2026-09-01T00:16:37,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,193 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,195 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,197 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,199 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,201 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,203 copying build/lib/lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Serbian 2026-09-01T00:16:37,205 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,206 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,208 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,210 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,212 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,214 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,216 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,218 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,220 copying build/lib/lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Albanian 2026-09-01T00:16:37,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,223 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,226 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,228 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,230 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,232 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,234 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,235 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,237 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,239 copying build/lib/lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Italian 2026-09-01T00:16:37,242 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,243 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,245 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,246 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,248 copying build/lib/lm_eval/tasks/include/few_shot_og/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,250 copying build/lib/lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,252 copying build/lib/lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/German 2026-09-01T00:16:37,255 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,256 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,258 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,260 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,261 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,263 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,265 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,267 copying build/lib/lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Telugu 2026-09-01T00:16:37,270 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,271 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,273 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,275 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,277 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,279 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,281 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,282 copying build/lib/lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Bengali 2026-09-01T00:16:37,285 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,286 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,288 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,290 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,292 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_north_macedonian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,294 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,296 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north_macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,298 copying build/lib/lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/North Macedonian 2026-09-01T00:16:37,301 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,302 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,304 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,306 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,308 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,309 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,311 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,313 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,316 copying build/lib/lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Persian 2026-09-01T00:16:37,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,319 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,322 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,323 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,325 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,327 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,329 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,331 copying build/lib/lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Armenian 2026-09-01T00:16:37,333 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:16:37,334 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:16:37,337 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:16:37,339 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:16:37,341 copying build/lib/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Basque 2026-09-01T00:16:37,343 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,344 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,346 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,348 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,350 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,352 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,354 copying build/lib/lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Vietnamese 2026-09-01T00:16:37,357 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,358 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,360 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,362 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,364 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,366 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,367 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,369 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,371 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,373 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,374 copying build/lib/lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Greek 2026-09-01T00:16:37,377 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,378 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,380 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,382 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,383 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,385 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,387 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,389 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,391 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,393 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,394 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,396 copying build/lib/lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Chinese 2026-09-01T00:16:37,399 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,400 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,402 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,404 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,406 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,408 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,409 copying build/lib/lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Polish 2026-09-01T00:16:37,412 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,412 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,414 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,417 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,420 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,422 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,424 copying build/lib/lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Urdu 2026-09-01T00:16:37,427 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,428 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,430 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,433 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,435 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,437 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,439 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,442 copying build/lib/lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Spanish 2026-09-01T00:16:37,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,446 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,448 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,450 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,453 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,455 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,457 copying build/lib/lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malay 2026-09-01T00:16:37,460 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,461 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,464 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,466 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,468 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,471 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,473 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,475 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,478 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,480 copying build/lib/lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Malayalam 2026-09-01T00:16:37,483 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,484 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,487 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,489 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,491 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,494 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,496 copying build/lib/lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Croatian 2026-09-01T00:16:37,499 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,500 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,502 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,504 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,506 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,508 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,510 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,512 copying build/lib/lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Turkish 2026-09-01T00:16:37,515 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:37,517 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:37,519 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:37,521 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:37,522 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:37,524 copying build/lib/lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Korean 2026-09-01T00:16:37,527 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:16:37,528 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:16:37,530 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:16:37,532 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:16:37,534 copying build/lib/lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Georgian 2026-09-01T00:16:37,536 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:16:37,537 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:16:37,539 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:16:37,541 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:16:37,543 copying build/lib/lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Kazakh 2026-09-01T00:16:37,546 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:37,547 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:37,549 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:37,550 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:37,552 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:37,554 copying build/lib/lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Tagalog 2026-09-01T00:16:37,557 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,558 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,560 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,562 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,564 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,566 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,568 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,570 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,571 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,573 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,575 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,577 copying build/lib/lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Russian 2026-09-01T00:16:37,579 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,581 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,583 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,584 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,586 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,588 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,590 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,592 copying build/lib/lm_eval/tasks/include/few_shot_og/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/few_shot_og/Uzbek 2026-09-01T00:16:37,595 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default 2026-09-01T00:16:37,597 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,598 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,600 copying build/lib/lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,602 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,604 copying build/lib/lm_eval/tasks/include/default/Ukrainian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,606 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,608 copying build/lib/lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Ukrainian 2026-09-01T00:16:37,610 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,611 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,613 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,616 copying build/lib/lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,618 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,620 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,622 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,624 copying build/lib/lm_eval/tasks/include/default/Hindi/_hindi_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,626 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,627 copying build/lib/lm_eval/tasks/include/default/Hindi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,629 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,631 copying build/lib/lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hindi 2026-09-01T00:16:37,633 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,634 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,636 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,638 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,640 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,642 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,644 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,646 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,648 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,650 copying build/lib/lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Azerbaijani 2026-09-01T00:16:37,652 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,653 copying build/lib/lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,656 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,658 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,660 copying build/lib/lm_eval/tasks/include/default/Hungarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,662 copying build/lib/lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,663 copying build/lib/lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hungarian 2026-09-01T00:16:37,666 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,667 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,669 copying build/lib/lm_eval/tasks/include/default/Dutch/_dutch_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,671 copying build/lib/lm_eval/tasks/include/default/Dutch/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,673 copying build/lib/lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,675 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,676 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,678 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,680 copying build/lib/lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Dutch 2026-09-01T00:16:37,682 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,683 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,685 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,687 copying build/lib/lm_eval/tasks/include/default/Arabic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,688 copying build/lib/lm_eval/tasks/include/default/Arabic/_arabic_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,690 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,692 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,694 copying build/lib/lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,696 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,697 copying build/lib/lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Arabic 2026-09-01T00:16:37,700 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/French 2026-09-01T00:16:37,702 copying build/lib/lm_eval/tasks/include/default/French/_include_base_44_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,704 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,706 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,708 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,710 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,711 copying build/lib/lm_eval/tasks/include/default/French/_french_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,713 copying build/lib/lm_eval/tasks/include/default/French/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,715 copying build/lib/lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/French 2026-09-01T00:16:37,717 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:37,718 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:37,720 copying build/lib/lm_eval/tasks/include/default/Nepali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:37,722 copying build/lib/lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:37,724 copying build/lib/lm_eval/tasks/include/default/Nepali/_nepali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:37,726 copying build/lib/lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Nepali 2026-09-01T00:16:37,728 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,729 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,731 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,733 copying build/lib/lm_eval/tasks/include/default/Estonian/_estonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,736 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,738 copying build/lib/lm_eval/tasks/include/default/Estonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,740 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,742 copying build/lib/lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,744 copying build/lib/lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Estonian 2026-09-01T00:16:37,746 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,747 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,749 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,751 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,753 copying build/lib/lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,755 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,757 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,759 copying build/lib/lm_eval/tasks/include/default/Portuguese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,760 copying build/lib/lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,762 copying build/lib/lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Portuguese 2026-09-01T00:16:37,765 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:37,766 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:37,768 copying build/lib/lm_eval/tasks/include/default/Hebrew/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:37,770 copying build/lib/lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:37,772 copying build/lib/lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:37,774 copying build/lib/lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Hebrew 2026-09-01T00:16:37,777 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,778 copying build/lib/lm_eval/tasks/include/default/Finnish/_finnish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,780 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,782 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,784 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,786 copying build/lib/lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,788 copying build/lib/lm_eval/tasks/include/default/Finnish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,790 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,792 copying build/lib/lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Finnish 2026-09-01T00:16:37,794 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,795 copying build/lib/lm_eval/tasks/include/default/Japanese/_japanese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,797 copying build/lib/lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,799 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,801 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,803 copying build/lib/lm_eval/tasks/include/default/Japanese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,805 copying build/lib/lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Japanese 2026-09-01T00:16:37,808 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,809 copying build/lib/lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,811 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,813 copying build/lib/lm_eval/tasks/include/default/Indonesian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,814 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,816 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,818 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,820 copying build/lib/lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,822 copying build/lib/lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Indonesian 2026-09-01T00:16:37,824 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,826 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,828 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,829 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,831 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,833 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,835 copying build/lib/lm_eval/tasks/include/default/Lithuanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,837 copying build/lib/lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,839 copying build/lib/lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Lithuanian 2026-09-01T00:16:37,841 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,842 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,844 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,846 copying build/lib/lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,848 copying build/lib/lm_eval/tasks/include/default/Bulgarian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,850 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,852 copying build/lib/lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bulgarian 2026-09-01T00:16:37,854 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:37,855 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:37,857 copying build/lib/lm_eval/tasks/include/default/Tamil/_tamil_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:37,859 copying build/lib/lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:37,861 copying build/lib/lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:37,863 copying build/lib/lm_eval/tasks/include/default/Tamil/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tamil 2026-09-01T00:16:37,866 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,867 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,869 copying build/lib/lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,871 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,873 copying build/lib/lm_eval/tasks/include/default/Belarusian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,875 copying build/lib/lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,878 copying build/lib/lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Belarusian 2026-09-01T00:16:37,880 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,881 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,883 copying build/lib/lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,885 copying build/lib/lm_eval/tasks/include/default/Serbian/_serbian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,887 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,889 copying build/lib/lm_eval/tasks/include/default/Serbian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,891 copying build/lib/lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Serbian 2026-09-01T00:16:37,894 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,895 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,897 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,899 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,901 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,903 copying build/lib/lm_eval/tasks/include/default/Albanian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,905 copying build/lib/lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,907 copying build/lib/lm_eval/tasks/include/default/Albanian/_albanian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,909 copying build/lib/lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Albanian 2026-09-01T00:16:37,912 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,913 copying build/lib/lm_eval/tasks/include/default/Italian/_italian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,915 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,917 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,919 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,921 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,923 copying build/lib/lm_eval/tasks/include/default/Italian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,925 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,927 copying build/lib/lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,929 copying build/lib/lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Italian 2026-09-01T00:16:37,932 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/German 2026-09-01T00:16:37,933 copying build/lib/lm_eval/tasks/include/default/German/_german_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:16:37,935 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:16:37,937 copying build/lib/lm_eval/tasks/include/default/German/_include_base_44_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:16:37,938 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:16:37,940 copying build/lib/lm_eval/tasks/include/default/German/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:16:37,942 copying build/lib/lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/German 2026-09-01T00:16:37,947 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,948 copying build/lib/lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,950 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,952 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,954 copying build/lib/lm_eval/tasks/include/default/Telugu/_telugu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,956 copying build/lib/lm_eval/tasks/include/default/Telugu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,958 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,960 copying build/lib/lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Telugu 2026-09-01T00:16:37,962 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,964 copying build/lib/lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,966 copying build/lib/lm_eval/tasks/include/default/Bengali/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,968 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,970 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,972 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,974 copying build/lib/lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,976 copying build/lib/lm_eval/tasks/include/default/Bengali/_bengali_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Bengali 2026-09-01T00:16:37,978 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,980 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,982 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,984 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,986 copying build/lib/lm_eval/tasks/include/default/North Macedonian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,987 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_include_base_44_north_macedonian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,989 copying build/lib/lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,991 copying build/lib/lm_eval/tasks/include/default/North Macedonian/_north_macedonian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/North Macedonian 2026-09-01T00:16:37,994 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Persian 2026-09-01T00:16:37,995 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:37,997 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:37,999 copying build/lib/lm_eval/tasks/include/default/Persian/_persian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:38,001 copying build/lib/lm_eval/tasks/include/default/Persian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:38,003 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:38,005 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:38,007 copying build/lib/lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:38,009 copying build/lib/lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Persian 2026-09-01T00:16:38,011 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,012 copying build/lib/lm_eval/tasks/include/default/Armenian/_armenian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,015 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,017 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,018 copying build/lib/lm_eval/tasks/include/default/Armenian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,020 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,022 copying build/lib/lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,024 copying build/lib/lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Armenian 2026-09-01T00:16:38,026 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Basque 2026-09-01T00:16:38,027 copying build/lib/lm_eval/tasks/include/default/Basque/_basque_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:16:38,030 copying build/lib/lm_eval/tasks/include/default/Basque/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:16:38,031 copying build/lib/lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:16:38,033 copying build/lib/lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Basque 2026-09-01T00:16:38,035 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,037 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,039 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,040 copying build/lib/lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,042 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,044 copying build/lib/lm_eval/tasks/include/default/Vietnamese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,046 copying build/lib/lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Vietnamese 2026-09-01T00:16:38,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,050 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,052 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,054 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,056 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,058 copying build/lib/lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,060 copying build/lib/lm_eval/tasks/include/default/Greek/_greek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,062 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,063 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,065 copying build/lib/lm_eval/tasks/include/default/Greek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,067 copying build/lib/lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Greek 2026-09-01T00:16:38,070 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,071 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,073 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,075 copying build/lib/lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,077 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,079 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,081 copying build/lib/lm_eval/tasks/include/default/Chinese/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,083 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,085 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,087 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,089 copying build/lib/lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,091 copying build/lib/lm_eval/tasks/include/default/Chinese/_chinese_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Chinese 2026-09-01T00:16:38,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,095 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,097 copying build/lib/lm_eval/tasks/include/default/Polish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,099 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,101 copying build/lib/lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,103 copying build/lib/lm_eval/tasks/include/default/Polish/_polish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,104 copying build/lib/lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Polish 2026-09-01T00:16:38,107 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,108 copying build/lib/lm_eval/tasks/include/default/Urdu/_urdu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,110 copying build/lib/lm_eval/tasks/include/default/Urdu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,112 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,114 copying build/lib/lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,115 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,117 copying build/lib/lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Urdu 2026-09-01T00:16:38,120 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,121 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,123 copying build/lib/lm_eval/tasks/include/default/Spanish/_spanish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,125 copying build/lib/lm_eval/tasks/include/default/Spanish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,127 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,129 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,131 copying build/lib/lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,132 copying build/lib/lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Spanish 2026-09-01T00:16:38,135 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,136 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,138 copying build/lib/lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,140 copying build/lib/lm_eval/tasks/include/default/Malay/_malay_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,142 copying build/lib/lm_eval/tasks/include/default/Malay/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,144 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,146 copying build/lib/lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malay 2026-09-01T00:16:38,149 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,150 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,152 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,153 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,155 copying build/lib/lm_eval/tasks/include/default/Malayalam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,157 copying build/lib/lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,159 copying build/lib/lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,161 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,163 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,164 copying build/lib/lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Malayalam 2026-09-01T00:16:38,167 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,168 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,170 copying build/lib/lm_eval/tasks/include/default/Croatian/_croatian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,172 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,174 copying build/lib/lm_eval/tasks/include/default/Croatian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,176 copying build/lib/lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,178 copying build/lib/lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Croatian 2026-09-01T00:16:38,180 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,181 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,183 copying build/lib/lm_eval/tasks/include/default/Turkish/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,185 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,187 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,189 copying build/lib/lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,191 copying build/lib/lm_eval/tasks/include/default/Turkish/_turkish_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,193 copying build/lib/lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Turkish 2026-09-01T00:16:38,195 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Korean 2026-09-01T00:16:38,196 copying build/lib/lm_eval/tasks/include/default/Korean/_korean_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:16:38,198 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:16:38,200 copying build/lib/lm_eval/tasks/include/default/Korean/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:16:38,202 copying build/lib/lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:16:38,204 copying build/lib/lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Korean 2026-09-01T00:16:38,207 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Georgian 2026-09-01T00:16:38,208 copying build/lib/lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:16:38,210 copying build/lib/lm_eval/tasks/include/default/Georgian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:16:38,212 copying build/lib/lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:16:38,214 copying build/lib/lm_eval/tasks/include/default/Georgian/_georgian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Georgian 2026-09-01T00:16:38,217 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Kazakh 2026-09-01T00:16:38,218 copying build/lib/lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:16:38,220 copying build/lib/lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:16:38,222 copying build/lib/lm_eval/tasks/include/default/Kazakh/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:16:38,224 copying build/lib/lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Kazakh 2026-09-01T00:16:38,227 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:38,228 copying build/lib/lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:38,230 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:38,232 copying build/lib/lm_eval/tasks/include/default/Tagalog/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:38,234 copying build/lib/lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:38,236 copying build/lib/lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Tagalog 2026-09-01T00:16:38,239 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,240 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,242 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,244 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,246 copying build/lib/lm_eval/tasks/include/default/Russian/_russian_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,247 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,249 copying build/lib/lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,251 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,253 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,255 copying build/lib/lm_eval/tasks/include/default/Russian/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,257 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,259 copying build/lib/lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Russian 2026-09-01T00:16:38,262 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,263 copying build/lib/lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,265 copying build/lib/lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,267 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,269 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,271 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,273 copying build/lib/lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,275 copying build/lib/lm_eval/tasks/include/default/Uzbek/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/include/default/Uzbek 2026-09-01T00:16:38,279 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longbench 2026-09-01T00:16:38,280 copying build/lib/lm_eval/tasks/longbench/hotpotqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,282 copying build/lib/lm_eval/tasks/longbench/musique.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,284 copying build/lib/lm_eval/tasks/longbench/_longbench_multi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,286 copying build/lib/lm_eval/tasks/longbench/repobench-p.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,288 copying build/lib/lm_eval/tasks/longbench/multi_news_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,290 copying build/lib/lm_eval/tasks/longbench/_longbench_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,292 copying build/lib/lm_eval/tasks/longbench/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,294 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,296 copying build/lib/lm_eval/tasks/longbench/passage_count_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,298 copying build/lib/lm_eval/tasks/longbench/_longbench_multi_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,300 copying build/lib/lm_eval/tasks/longbench/multi_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,302 copying build/lib/lm_eval/tasks/longbench/gov_report.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,304 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,306 copying build/lib/lm_eval/tasks/longbench/_longbench_synthetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,308 copying build/lib/lm_eval/tasks/longbench/_longbench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,310 copying build/lib/lm_eval/tasks/longbench/qasper_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,312 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,314 copying build/lib/lm_eval/tasks/longbench/repobench-p_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,315 copying build/lib/lm_eval/tasks/longbench/lsht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,317 copying build/lib/lm_eval/tasks/longbench/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,320 copying build/lib/lm_eval/tasks/longbench/qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,322 copying build/lib/lm_eval/tasks/longbench/qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,324 copying build/lib/lm_eval/tasks/longbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,326 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,328 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,330 copying build/lib/lm_eval/tasks/longbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,332 copying build/lib/lm_eval/tasks/longbench/hotpotqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,334 copying build/lib/lm_eval/tasks/longbench/triviaqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,337 copying build/lib/lm_eval/tasks/longbench/vcsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,338 copying build/lib/lm_eval/tasks/longbench/passage_retrieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,340 copying build/lib/lm_eval/tasks/longbench/trec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,342 copying build/lib/lm_eval/tasks/longbench/lcc_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,344 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,345 copying build/lib/lm_eval/tasks/longbench/gov_report_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,347 copying build/lib/lm_eval/tasks/longbench/_longbench_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,349 copying build/lib/lm_eval/tasks/longbench/multifieldqa_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,350 copying build/lib/lm_eval/tasks/longbench/triviaqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,352 copying build/lib/lm_eval/tasks/longbench/lcc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,354 copying build/lib/lm_eval/tasks/longbench/2wikimqa_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,356 copying build/lib/lm_eval/tasks/longbench/_longbench_fewshot_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,358 copying build/lib/lm_eval/tasks/longbench/samsum_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,359 copying build/lib/lm_eval/tasks/longbench/2wikimqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,361 copying build/lib/lm_eval/tasks/longbench/_longbench_code_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,363 copying build/lib/lm_eval/tasks/longbench/_longbench_single.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,365 copying build/lib/lm_eval/tasks/longbench/narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,366 copying build/lib/lm_eval/tasks/longbench/samsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,368 copying build/lib/lm_eval/tasks/longbench/_longbench_summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,370 copying build/lib/lm_eval/tasks/longbench/dureader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,372 copying build/lib/lm_eval/tasks/longbench/trec_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,374 copying build/lib/lm_eval/tasks/longbench/passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,376 copying build/lib/lm_eval/tasks/longbench/_longbench_single_e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,378 copying build/lib/lm_eval/tasks/longbench/multifieldqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longbench 2026-09-01T00:16:38,381 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi 2026-09-01T00:16:38,383 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,384 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,386 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,388 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,390 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,392 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,394 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,396 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,398 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,400 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,402 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,404 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,405 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,407 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,409 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,411 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,413 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,415 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,417 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,419 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,421 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,423 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,424 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,426 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,428 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,430 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,432 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,434 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,436 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,438 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,440 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,442 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,444 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,446 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2026-09-01T00:16:38,449 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,450 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,452 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,454 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,456 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,457 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,459 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,461 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,463 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,466 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,467 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,469 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,471 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,473 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,475 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,477 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,479 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,481 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,483 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,485 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,486 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,488 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,490 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,492 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,494 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,496 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,498 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,500 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,502 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,504 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,506 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,508 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,510 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,512 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,513 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,515 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,517 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2026-09-01T00:16:38,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,522 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,524 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,526 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,528 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,530 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,532 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,534 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,536 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,537 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,539 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,541 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,543 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,545 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,547 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,549 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,550 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,552 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,554 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,556 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,558 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,560 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,562 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,564 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,566 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,568 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,569 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,571 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,573 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,575 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,577 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,578 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,580 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,582 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,584 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,586 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,587 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,589 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,591 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,593 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,595 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,597 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,599 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,601 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,603 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,605 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,607 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,609 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,610 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,612 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,614 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,616 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,618 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,619 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,621 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,623 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,625 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,627 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,629 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,631 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,633 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,634 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,636 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,638 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,640 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,642 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,644 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2026-09-01T00:16:38,647 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,648 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,650 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,652 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,654 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,655 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,657 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,659 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,661 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,662 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,664 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,666 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,668 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,669 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,671 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,673 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,675 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,677 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,679 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,681 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,683 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,685 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,687 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,689 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,691 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,693 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,695 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,696 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,698 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,700 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,702 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,704 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,706 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,707 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,709 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2026-09-01T00:16:38,712 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kobest 2026-09-01T00:16:38,713 copying build/lib/lm_eval/tasks/kobest/kobest_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,715 copying build/lib/lm_eval/tasks/kobest/kobest_wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,717 copying build/lib/lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,719 copying build/lib/lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,721 copying build/lib/lm_eval/tasks/kobest/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,722 copying build/lib/lm_eval/tasks/kobest/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,724 copying build/lib/lm_eval/tasks/kobest/kobest_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,726 copying build/lib/lm_eval/tasks/kobest/_kobest.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2026-09-01T00:16:38,729 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/realtoxicityprompts 2026-09-01T00:16:38,730 copying build/lib/lm_eval/tasks/realtoxicityprompts/metric.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2026-09-01T00:16:38,732 copying build/lib/lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2026-09-01T00:16:38,734 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,736 copying build/lib/lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,739 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,740 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,742 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,744 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,746 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,748 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,750 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,752 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,754 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,756 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,758 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,759 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,761 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,763 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,765 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,767 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,769 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,771 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,773 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,775 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2026-09-01T00:16:38,777 copying build/lib/lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,779 copying build/lib/lm_eval/tasks/portuguese_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,781 copying build/lib/lm_eval/tasks/portuguese_bench/assin2_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,782 copying build/lib/lm_eval/tasks/portuguese_bench/assin2_sts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,784 copying build/lib/lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,786 copying build/lib/lm_eval/tasks/portuguese_bench/assin2_rte.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2026-09-01T00:16:38,789 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmdp 2026-09-01T00:16:38,790 copying build/lib/lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:16:38,792 copying build/lib/lm_eval/tasks/wmdp/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:16:38,794 copying build/lib/lm_eval/tasks/wmdp/_wmdp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:16:38,796 copying build/lib/lm_eval/tasks/wmdp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:16:38,798 copying build/lib/lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:16:38,800 copying build/lib/lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2026-09-01T00:16:38,803 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/longproc 2026-09-01T00:16:38,804 copying build/lib/lm_eval/tasks/longproc/travel_planning_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,806 copying build/lib/lm_eval/tasks/longproc/html_to_tsv_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,808 copying build/lib/lm_eval/tasks/longproc/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,811 copying build/lib/lm_eval/tasks/longproc/tom_tracking_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,813 copying build/lib/lm_eval/tasks/longproc/pseudo_to_code_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,815 copying build/lib/lm_eval/tasks/longproc/tom_tracking_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,816 copying build/lib/lm_eval/tasks/longproc/path_traversal_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,818 copying build/lib/lm_eval/tasks/longproc/_default_yaml_0.5k -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,820 copying build/lib/lm_eval/tasks/longproc/_longproc_countdown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,822 copying build/lib/lm_eval/tasks/longproc/_longproc_tom_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,824 copying build/lib/lm_eval/tasks/longproc/countdown_0.5k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,826 copying build/lib/lm_eval/tasks/longproc/tom_tracking_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,828 copying build/lib/lm_eval/tasks/longproc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,830 copying build/lib/lm_eval/tasks/longproc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,832 copying build/lib/lm_eval/tasks/longproc/_default_yaml_8k -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,834 copying build/lib/lm_eval/tasks/longproc/path_traversal_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,836 copying build/lib/lm_eval/tasks/longproc/countdown_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,838 copying build/lib/lm_eval/tasks/longproc/_longproc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,840 copying build/lib/lm_eval/tasks/longproc/_longproc_pseudo_to_code.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,842 copying build/lib/lm_eval/tasks/longproc/_longproc_html_to_tsv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,844 copying build/lib/lm_eval/tasks/longproc/_longproc_path_traversal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,846 copying build/lib/lm_eval/tasks/longproc/countdown_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,848 copying build/lib/lm_eval/tasks/longproc/html_to_tsv_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,850 copying build/lib/lm_eval/tasks/longproc/_default_yaml_2k -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,852 copying build/lib/lm_eval/tasks/longproc/travel_planning_8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,854 copying build/lib/lm_eval/tasks/longproc/html_to_tsv_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,856 copying build/lib/lm_eval/tasks/longproc/_longproc_travel_planning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,858 copying build/lib/lm_eval/tasks/longproc/path_traversal_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,860 copying build/lib/lm_eval/tasks/longproc/pseudo_to_code_2k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/longproc 2026-09-01T00:16:38,863 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile 2026-09-01T00:16:38,864 copying build/lib/lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,866 copying build/lib/lm_eval/tasks/pile/pile_github.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,868 copying build/lib/lm_eval/tasks/pile/pile_enron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,870 copying build/lib/lm_eval/tasks/pile/pile_uspto.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,872 copying build/lib/lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,873 copying build/lib/lm_eval/tasks/pile/pile_books3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,875 copying build/lib/lm_eval/tasks/pile/pile_pile-cc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,877 copying build/lib/lm_eval/tasks/pile/pile_hackernews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,879 copying build/lib/lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,881 copying build/lib/lm_eval/tasks/pile/pile_europarl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,883 copying build/lib/lm_eval/tasks/pile/pile_arxiv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,885 copying build/lib/lm_eval/tasks/pile/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,887 copying build/lib/lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,889 copying build/lib/lm_eval/tasks/pile/pile_philpapers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,891 copying build/lib/lm_eval/tasks/pile/pile_gutenberg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,893 copying build/lib/lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,895 copying build/lib/lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,897 copying build/lib/lm_eval/tasks/pile/pile_stackexchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,899 copying build/lib/lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,901 copying build/lib/lm_eval/tasks/pile/pile_freelaw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,903 copying build/lib/lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,905 copying build/lib/lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,907 copying build/lib/lm_eval/tasks/pile/pile_wikipedia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2026-09-01T00:16:38,909 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/commonsense_qa 2026-09-01T00:16:38,910 copying build/lib/lm_eval/tasks/commonsense_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2026-09-01T00:16:38,913 copying build/lib/lm_eval/tasks/commonsense_qa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2026-09-01T00:16:38,915 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mathqa 2026-09-01T00:16:38,916 copying build/lib/lm_eval/tasks/mathqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-09-01T00:16:38,918 copying build/lib/lm_eval/tasks/mathqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-09-01T00:16:38,920 copying build/lib/lm_eval/tasks/mathqa/mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2026-09-01T00:16:38,922 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus 2026-09-01T00:16:38,923 copying build/lib/lm_eval/tasks/tmmluplus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2026-09-01T00:16:38,925 copying build/lib/lm_eval/tasks/tmmluplus/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2026-09-01T00:16:38,930 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,931 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,934 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,936 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,939 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,941 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,943 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,946 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,948 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,950 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,953 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,955 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,958 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,960 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,963 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,965 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,968 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,970 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,972 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,974 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,977 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,979 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,981 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,983 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,986 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,988 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,990 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,993 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,995 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:38,998 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,000 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,002 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,005 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,007 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,009 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,012 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,014 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,017 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,019 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,021 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,023 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,026 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,028 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,030 copying build/lib/lm_eval/tasks/tmmluplus/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,032 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,034 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,035 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,037 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,039 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,041 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,043 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,045 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,047 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,049 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,050 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,052 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,054 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,056 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,058 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,060 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,062 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,064 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,066 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,068 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,070 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,071 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,073 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,075 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,077 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,079 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,081 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,082 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,084 copying build/lib/lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,086 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,088 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,090 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2026-09-01T00:16:39,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks 2026-09-01T00:16:39,094 copying build/lib/lm_eval/tasks/benchmarks/pythia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:16:39,097 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/flan 2026-09-01T00:16:39,098 copying build/lib/lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-09-01T00:16:39,100 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-09-01T00:16:39,103 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2026-09-01T00:16:39,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:16:39,106 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:16:39,108 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2026-09-01T00:16:39,110 copying build/lib/lm_eval/tasks/benchmarks/minerva_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:16:39,112 copying build/lib/lm_eval/tasks/benchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:16:39,114 copying build/lib/lm_eval/tasks/benchmarks/t0_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:16:39,117 copying build/lib/lm_eval/tasks/benchmarks/openllm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2026-09-01T00:16:39,119 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,120 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,122 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,124 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,126 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,128 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,130 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,132 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,133 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,135 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,137 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,139 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,141 copying build/lib/lm_eval/tasks/crows_pairs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,143 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,145 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,147 copying build/lib/lm_eval/tasks/crows_pairs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,149 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,151 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,153 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,155 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,157 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,159 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,161 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,163 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,165 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2026-09-01T00:16:39,167 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bertaqa 2026-09-01T00:16:39,168 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,170 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,172 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,174 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,176 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,178 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,180 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,181 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,183 copying build/lib/lm_eval/tasks/bertaqa/_bertaqa_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,185 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,187 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,189 copying build/lib/lm_eval/tasks/bertaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,191 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,193 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,195 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,197 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,198 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,200 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2026-09-01T00:16:39,203 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darijahellaswag 2026-09-01T00:16:39,204 copying build/lib/lm_eval/tasks/darijahellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-09-01T00:16:39,206 copying build/lib/lm_eval/tasks/darijahellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-09-01T00:16:39,208 copying build/lib/lm_eval/tasks/darijahellaswag/darijahellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darijahellaswag 2026-09-01T00:16:39,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa 2026-09-01T00:16:39,212 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:16:39,213 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:16:39,215 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2026-09-01T00:16:39,218 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:16:39,219 copying build/lib/lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:16:39,221 copying build/lib/lm_eval/tasks/alghafa/copa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2026-09-01T00:16:39,223 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh 2026-09-01T00:16:39,225 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,227 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,229 copying build/lib/lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,230 copying build/lib/lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,232 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,234 copying build/lib/lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,236 copying build/lib/lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,238 copying build/lib/lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,239 copying build/lib/lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,241 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,243 copying build/lib/lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,245 copying build/lib/lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,247 copying build/lib/lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,249 copying build/lib/lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,251 copying build/lib/lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,253 copying build/lib/lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,254 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,257 copying build/lib/lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,258 copying build/lib/lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,260 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,262 copying build/lib/lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,264 copying build/lib/lm_eval/tasks/bbh/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,267 copying build/lib/lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,269 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,271 copying build/lib/lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,273 copying build/lib/lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,274 copying build/lib/lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,276 copying build/lib/lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,278 copying build/lib/lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,280 copying build/lib/lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,282 copying build/lib/lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2026-09-01T00:16:39,283 copying build/lib/lm_eval/tasks/bbh/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2026-09-01T00:16:39,287 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,288 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,290 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,291 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,293 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,295 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,297 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,299 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,301 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,303 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,304 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,306 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,308 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,310 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,312 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,314 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,316 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,318 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,320 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,322 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,324 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,326 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,328 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,331 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,332 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,334 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,336 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,338 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,340 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,342 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,344 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2026-09-01T00:16:39,347 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,349 copying build/lib/lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,351 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,353 copying build/lib/lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,355 copying build/lib/lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,357 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,359 copying build/lib/lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,361 copying build/lib/lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,363 copying build/lib/lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,365 copying build/lib/lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,367 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,369 copying build/lib/lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,371 copying build/lib/lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,373 copying build/lib/lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,375 copying build/lib/lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,377 copying build/lib/lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,378 copying build/lib/lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,380 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,382 copying build/lib/lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,384 copying build/lib/lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,386 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,388 copying build/lib/lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,390 copying build/lib/lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,392 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,394 copying build/lib/lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,396 copying build/lib/lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,398 copying build/lib/lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,400 copying build/lib/lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,402 copying build/lib/lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,404 copying build/lib/lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2026-09-01T00:16:39,407 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,408 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,410 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,412 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,414 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,416 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,418 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,421 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,423 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,425 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,427 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,429 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,431 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,433 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,435 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,437 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,439 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,441 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,443 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,445 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,447 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,449 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,451 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,453 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,455 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,457 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,459 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,461 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,463 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,465 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,467 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2026-09-01T00:16:39,469 copying build/lib/lm_eval/tasks/bbh/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2026-09-01T00:16:39,472 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_text_classification 2026-09-01T00:16:39,473 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-09-01T00:16:39,475 copying build/lib/lm_eval/tasks/med_text_classification/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-09-01T00:16:39,477 copying build/lib/lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_text_classification 2026-09-01T00:16:39,479 copying build/lib/lm_eval/tasks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:16:39,484 copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:16:39,487 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/discrim_eval 2026-09-01T00:16:39,488 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:16:39,490 copying build/lib/lm_eval/tasks/discrim_eval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:16:39,492 copying build/lib/lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:16:39,494 copying build/lib/lm_eval/tasks/discrim_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/discrim_eval 2026-09-01T00:16:39,497 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,498 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,500 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,502 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,504 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,506 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,508 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,510 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,512 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,514 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,516 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,518 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,520 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,522 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,524 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,526 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,528 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,530 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,531 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,533 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,535 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,537 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,539 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,541 copying build/lib/lm_eval/tasks/arabicmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,543 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,544 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,546 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,548 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,550 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,552 copying build/lib/lm_eval/tasks/arabicmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,554 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,556 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,558 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,560 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,562 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,563 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,565 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,567 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,569 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,571 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,573 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,576 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,577 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,579 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,581 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,583 copying build/lib/lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,585 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,587 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,588 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,590 copying build/lib/lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,593 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2026-09-01T00:16:39,595 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals 2026-09-01T00:16:39,597 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:16:39,598 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:16:39,600 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:16:39,602 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2026-09-01T00:16:39,605 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:16:39,606 copying build/lib/lm_eval/tasks/model_written_evals/winogenerated/winogenerated -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/winogenerated 2026-09-01T00:16:39,609 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,610 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,612 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,615 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,617 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,619 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,621 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,623 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,625 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,627 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,629 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,631 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,632 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,634 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,636 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,638 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,640 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,642 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,644 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,646 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,648 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,650 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,652 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,654 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,656 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,658 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,660 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,662 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,663 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,665 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,667 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,669 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,671 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,673 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,675 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,677 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,679 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,681 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,683 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,685 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,687 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,689 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,691 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,693 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,696 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,698 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,699 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,701 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,703 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,706 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,708 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,710 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2026-09-01T00:16:39,715 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,716 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,718 copying build/lib/lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,720 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,722 copying build/lib/lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,724 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,726 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,728 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,730 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,732 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,734 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,737 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,740 copying build/lib/lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,742 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,744 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,746 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,749 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,751 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,753 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,756 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,758 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,760 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,763 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,765 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,768 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,770 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,773 copying build/lib/lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,775 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,778 copying build/lib/lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,780 copying build/lib/lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,783 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,785 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,788 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,790 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,793 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,795 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,797 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,800 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,802 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,804 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,807 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,809 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,812 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,814 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,816 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,819 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,821 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,823 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,826 copying build/lib/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,828 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,830 copying build/lib/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,833 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,835 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,837 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,839 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,842 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,844 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,846 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,849 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,851 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,854 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,856 copying build/lib/lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,859 copying build/lib/lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,861 copying build/lib/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,863 copying build/lib/lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,866 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,868 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,887 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,889 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,892 copying build/lib/lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,894 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,896 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,898 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,901 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,902 copying build/lib/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,904 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,906 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,908 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,910 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,913 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,914 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,917 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,919 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,921 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,923 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,925 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,927 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,929 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,931 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,933 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,936 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,938 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,940 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,942 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,944 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,946 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,948 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,950 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,952 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,955 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,957 copying build/lib/lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,959 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,961 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,964 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,966 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,968 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,971 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,973 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,975 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,977 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,979 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,981 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,984 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,986 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,989 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,991 copying build/lib/lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,993 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,995 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,997 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:39,999 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,001 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,003 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,005 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,007 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,009 copying build/lib/lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,011 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,013 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,016 copying build/lib/lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,018 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,020 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,022 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,025 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,027 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,029 copying build/lib/lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,031 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,033 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,035 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,036 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2026-09-01T00:16:40,039 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue 2026-09-01T00:16:40,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/boolq 2026-09-01T00:16:40,041 copying build/lib/lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-09-01T00:16:40,043 copying build/lib/lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-09-01T00:16:40,044 copying build/lib/lm_eval/tasks/super_glue/boolq/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2026-09-01T00:16:40,047 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/rte 2026-09-01T00:16:40,048 copying build/lib/lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2026-09-01T00:16:40,049 copying build/lib/lm_eval/tasks/super_glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2026-09-01T00:16:40,052 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wsc 2026-09-01T00:16:40,053 copying build/lib/lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:16:40,055 copying build/lib/lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:16:40,056 copying build/lib/lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:16:40,058 copying build/lib/lm_eval/tasks/super_glue/wsc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2026-09-01T00:16:40,060 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/cb 2026-09-01T00:16:40,061 copying build/lib/lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:16:40,063 copying build/lib/lm_eval/tasks/super_glue/cb/aggregate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:16:40,065 copying build/lib/lm_eval/tasks/super_glue/cb/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:16:40,078 copying build/lib/lm_eval/tasks/super_glue/cb/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2026-09-01T00:16:40,080 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wic 2026-09-01T00:16:40,081 copying build/lib/lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2026-09-01T00:16:40,083 copying build/lib/lm_eval/tasks/super_glue/wic/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2026-09-01T00:16:40,085 copying build/lib/lm_eval/tasks/super_glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue 2026-09-01T00:16:40,088 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/record 2026-09-01T00:16:40,089 copying build/lib/lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:16:40,091 copying build/lib/lm_eval/tasks/super_glue/record/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:16:40,092 copying build/lib/lm_eval/tasks/super_glue/record/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:16:40,094 copying build/lib/lm_eval/tasks/super_glue/record/util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2026-09-01T00:16:40,096 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/multirc 2026-09-01T00:16:40,097 copying build/lib/lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-09-01T00:16:40,099 copying build/lib/lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-09-01T00:16:40,101 copying build/lib/lm_eval/tasks/super_glue/multirc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2026-09-01T00:16:40,103 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/copa 2026-09-01T00:16:40,104 copying build/lib/lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-09-01T00:16:40,106 copying build/lib/lm_eval/tasks/super_glue/copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-09-01T00:16:40,108 copying build/lib/lm_eval/tasks/super_glue/copa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2026-09-01T00:16:40,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toxigen 2026-09-01T00:16:40,114 copying build/lib/lm_eval/tasks/toxigen/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-09-01T00:16:40,116 copying build/lib/lm_eval/tasks/toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-09-01T00:16:40,117 copying build/lib/lm_eval/tasks/toxigen/toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2026-09-01T00:16:40,119 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_reading 2026-09-01T00:16:40,120 copying build/lib/lm_eval/tasks/eus_reading/eus_reading.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-09-01T00:16:40,122 copying build/lib/lm_eval/tasks/eus_reading/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-09-01T00:16:40,127 copying build/lib/lm_eval/tasks/eus_reading/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2026-09-01T00:16:40,131 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ceval 2026-09-01T00:16:40,132 copying build/lib/lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,134 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,136 copying build/lib/lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,138 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,140 copying build/lib/lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,141 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,143 copying build/lib/lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,145 copying build/lib/lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,147 copying build/lib/lm_eval/tasks/ceval/_ceval-valid.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,149 copying build/lib/lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,150 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,152 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,154 copying build/lib/lm_eval/tasks/ceval/_default_ceval_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,155 copying build/lib/lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,157 copying build/lib/lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,158 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,160 copying build/lib/lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,161 copying build/lib/lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,163 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,164 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,166 copying build/lib/lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,168 copying build/lib/lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,170 copying build/lib/lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,171 copying build/lib/lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,173 copying build/lib/lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,174 copying build/lib/lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,177 copying build/lib/lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,178 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,180 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,182 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,184 copying build/lib/lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,185 copying build/lib/lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,187 copying build/lib/lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,189 copying build/lib/lm_eval/tasks/ceval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,191 copying build/lib/lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,193 copying build/lib/lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,194 copying build/lib/lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,196 copying build/lib/lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,198 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,199 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,201 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,202 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,204 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,206 copying build/lib/lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,207 copying build/lib/lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,209 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,210 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,212 copying build/lib/lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,214 copying build/lib/lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,215 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,217 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,218 copying build/lib/lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,220 copying build/lib/lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,222 copying build/lib/lm_eval/tasks/ceval/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,224 copying build/lib/lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,226 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2026-09-01T00:16:40,229 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mela 2026-09-01T00:16:40,230 copying build/lib/lm_eval/tasks/mela/mela_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,232 copying build/lib/lm_eval/tasks/mela/mela_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,234 copying build/lib/lm_eval/tasks/mela/mela_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,235 copying build/lib/lm_eval/tasks/mela/mela_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,237 copying build/lib/lm_eval/tasks/mela/_mela.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,239 copying build/lib/lm_eval/tasks/mela/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,241 copying build/lib/lm_eval/tasks/mela/mela_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,242 copying build/lib/lm_eval/tasks/mela/mela_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,244 copying build/lib/lm_eval/tasks/mela/mela_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,245 copying build/lib/lm_eval/tasks/mela/mela_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,247 copying build/lib/lm_eval/tasks/mela/mela_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,249 copying build/lib/lm_eval/tasks/mela/mela_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2026-09-01T00:16:40,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aexams 2026-09-01T00:16:40,252 copying build/lib/lm_eval/tasks/aexams/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,254 copying build/lib/lm_eval/tasks/aexams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,255 copying build/lib/lm_eval/tasks/aexams/aexams_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,257 copying build/lib/lm_eval/tasks/aexams/aexams_Science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,259 copying build/lib/lm_eval/tasks/aexams/_aexams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,260 copying build/lib/lm_eval/tasks/aexams/aexams_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,262 copying build/lib/lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,263 copying build/lib/lm_eval/tasks/aexams/aexams_Social.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2026-09-01T00:16:40,265 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc_mt 2026-09-01T00:16:40,266 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,268 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,270 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,272 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,273 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,275 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,277 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,279 copying build/lib/lm_eval/tasks/arc_mt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,280 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,282 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,284 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,286 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,288 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2026-09-01T00:16:40,290 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/triviaqa 2026-09-01T00:16:40,291 copying build/lib/lm_eval/tasks/triviaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2026-09-01T00:16:40,293 copying build/lib/lm_eval/tasks/triviaqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2026-09-01T00:16:40,295 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/haerae 2026-09-01T00:16:40,296 copying build/lib/lm_eval/tasks/haerae/haerae_lw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,298 copying build/lib/lm_eval/tasks/haerae/_default_haerae_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,300 copying build/lib/lm_eval/tasks/haerae/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,301 copying build/lib/lm_eval/tasks/haerae/haerae_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,303 copying build/lib/lm_eval/tasks/haerae/haerae_gk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,305 copying build/lib/lm_eval/tasks/haerae/haerae_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,306 copying build/lib/lm_eval/tasks/haerae/_haerae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,308 copying build/lib/lm_eval/tasks/haerae/haerae_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2026-09-01T00:16:40,310 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k 2026-09-01T00:16:40,311 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:16:40,313 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:16:40,315 copying build/lib/lm_eval/tasks/gsm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:16:40,317 copying build/lib/lm_eval/tasks/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:16:40,319 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:16:40,320 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2026-09-01T00:16:40,322 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qa4mre 2026-09-01T00:16:40,323 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:16:40,325 copying build/lib/lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:16:40,327 copying build/lib/lm_eval/tasks/qa4mre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:16:40,329 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:16:40,331 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2026-09-01T00:16:40,333 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basqueglue 2026-09-01T00:16:40,334 copying build/lib/lm_eval/tasks/basqueglue/bhtc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,336 copying build/lib/lm_eval/tasks/basqueglue/bec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,338 copying build/lib/lm_eval/tasks/basqueglue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,340 copying build/lib/lm_eval/tasks/basqueglue/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,342 copying build/lib/lm_eval/tasks/basqueglue/wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,345 copying build/lib/lm_eval/tasks/basqueglue/coref.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,347 copying build/lib/lm_eval/tasks/basqueglue/vaxx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,348 copying build/lib/lm_eval/tasks/basqueglue/qnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2026-09-01T00:16:40,350 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/coqa 2026-09-01T00:16:40,351 copying build/lib/lm_eval/tasks/coqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-09-01T00:16:40,353 copying build/lib/lm_eval/tasks/coqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-09-01T00:16:40,356 copying build/lib/lm_eval/tasks/coqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2026-09-01T00:16:40,358 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu 2026-09-01T00:16:40,359 copying build/lib/lm_eval/tasks/afrimmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:16:40,361 copying build/lib/lm_eval/tasks/afrimmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:16:40,363 copying build/lib/lm_eval/tasks/afrimmlu/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:16:40,364 copying build/lib/lm_eval/tasks/afrimmlu/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2026-09-01T00:16:40,367 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate 2026-09-01T00:16:40,368 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2026-09-01T00:16:40,370 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,371 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,373 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,375 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,376 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,378 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,380 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,381 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,383 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,385 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,387 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,388 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,390 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,392 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,394 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,395 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,397 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,399 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,400 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,402 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_1 2026-09-01T00:16:40,404 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,405 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,407 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,409 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,411 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,412 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,414 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,416 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,418 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,419 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,421 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,423 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,425 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,426 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,428 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,430 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,431 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,433 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,435 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,436 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_4 2026-09-01T00:16:40,439 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,440 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,441 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,443 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,445 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,446 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,448 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,450 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,451 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,453 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,455 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,457 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,459 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,461 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,462 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,464 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,466 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,468 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,469 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,471 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_3 2026-09-01T00:16:40,473 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,474 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,476 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,478 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,479 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,481 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,483 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,484 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,486 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,487 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,489 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,491 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,493 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,495 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,497 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,499 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,500 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,502 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,504 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,506 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_5 2026-09-01T00:16:40,508 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,509 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,511 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,513 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,514 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,516 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,518 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,519 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,521 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,523 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,524 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,526 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,528 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,530 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,531 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,533 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,535 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,537 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,538 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,540 copying build/lib/lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate/prompt_2 2026-09-01T00:16:40,542 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct 2026-09-01T00:16:40,544 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2026-09-01T00:16:40,546 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,547 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,549 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,551 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,552 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,554 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,556 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,557 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,559 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,561 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,562 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,564 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,566 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,568 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,569 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,571 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,573 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,574 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,576 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,578 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,580 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_1 2026-09-01T00:16:40,582 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,583 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,585 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,587 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,589 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,590 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,592 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,593 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,595 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,597 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,598 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,600 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,601 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,603 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,604 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,606 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,608 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,610 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,611 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,613 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,615 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_4 2026-09-01T00:16:40,617 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,618 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,620 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,622 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,624 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,626 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,627 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,629 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,630 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,632 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,634 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,635 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,637 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,639 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,640 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,642 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,644 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,646 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,647 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,649 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,651 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_3 2026-09-01T00:16:40,653 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,654 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,656 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,658 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,660 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,662 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,664 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,665 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,667 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,669 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,670 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,672 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,673 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,675 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,677 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,678 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,680 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,681 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,683 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,685 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,687 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_5 2026-09-01T00:16:40,689 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,690 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,692 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,694 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,696 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,698 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,700 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,701 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,703 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,705 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,707 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,708 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,710 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,712 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,713 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,715 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,717 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,718 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,720 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,722 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,723 copying build/lib/lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct/prompt_2 2026-09-01T00:16:40,726 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/headqa 2026-09-01T00:16:40,727 copying build/lib/lm_eval/tasks/headqa/headqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-09-01T00:16:40,729 copying build/lib/lm_eval/tasks/headqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-09-01T00:16:40,731 copying build/lib/lm_eval/tasks/headqa/headqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2026-09-01T00:16:40,733 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval 2026-09-01T00:16:40,734 copying build/lib/lm_eval/tasks/humaneval/humaneval_64_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,736 copying build/lib/lm_eval/tasks/humaneval/humaneval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,738 copying build/lib/lm_eval/tasks/humaneval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,740 copying build/lib/lm_eval/tasks/humaneval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,742 copying build/lib/lm_eval/tasks/humaneval/humaneval_instruct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,744 copying build/lib/lm_eval/tasks/humaneval/humaneval_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,746 copying build/lib/lm_eval/tasks/humaneval/humaneval_64.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval 2026-09-01T00:16:40,748 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,749 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,751 copying build/lib/lm_eval/tasks/gsm8k_platinum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,752 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,754 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,756 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,757 copying build/lib/lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k_platinum 2026-09-01T00:16:40,760 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score 2026-09-01T00:16:40,761 copying build/lib/lm_eval/tasks/score/score_robustness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:16:40,763 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,764 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,766 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,768 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,769 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,771 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,773 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,774 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,776 copying build/lib/lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,778 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,779 copying build/lib/lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,782 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,783 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,785 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,787 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,789 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,791 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,792 copying build/lib/lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,795 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,797 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,798 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,800 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,802 copying build/lib/lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,803 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,805 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,807 copying build/lib/lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,809 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,811 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2026-09-01T00:16:40,813 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/math 2026-09-01T00:16:40,814 copying build/lib/lm_eval/tasks/score/math/score_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,816 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,818 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,819 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,821 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,823 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,825 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,826 copying build/lib/lm_eval/tasks/score/math/math_grader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,829 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,831 copying build/lib/lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,833 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,835 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,836 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,838 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,840 copying build/lib/lm_eval/tasks/score/math/utils_math.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,842 copying build/lib/lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,844 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,846 copying build/lib/lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,847 copying build/lib/lm_eval/tasks/score/math/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,849 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,851 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2026-09-01T00:16:40,853 copying build/lib/lm_eval/tasks/score/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:16:40,855 copying build/lib/lm_eval/tasks/score/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:16:40,857 copying build/lib/lm_eval/tasks/score/NON_GREEDY.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:16:40,859 copying build/lib/lm_eval/tasks/score/non_greedy_summarizer.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:16:40,861 copying build/lib/lm_eval/tasks/score/non_greedy.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2026-09-01T00:16:40,864 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:40,865 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:40,867 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:40,869 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:40,871 copying build/lib/lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:40,873 copying build/lib/lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2026-09-01T00:16:40,876 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,877 copying build/lib/lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,880 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,881 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,883 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,885 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,887 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,889 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,891 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,892 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,894 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,896 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,898 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,900 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,903 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,906 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,908 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,910 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,912 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,914 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,916 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,918 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2026-09-01T00:16:40,920 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:16:40,921 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:16:40,923 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:16:40,925 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2026-09-01T00:16:40,927 copying build/lib/lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,928 copying build/lib/lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,930 copying build/lib/lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,932 copying build/lib/lm_eval/tasks/spanish_bench/copa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,934 copying build/lib/lm_eval/tasks/spanish_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,936 copying build/lib/lm_eval/tasks/spanish_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,938 copying build/lib/lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,939 copying build/lib/lm_eval/tasks/spanish_bench/cocoteros_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,941 copying build/lib/lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,943 copying build/lib/lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,944 copying build/lib/lm_eval/tasks/spanish_bench/escola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2026-09-01T00:16:40,947 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/careqa 2026-09-01T00:16:40,948 copying build/lib/lm_eval/tasks/careqa/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,949 copying build/lib/lm_eval/tasks/careqa/careqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,951 copying build/lib/lm_eval/tasks/careqa/careqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,953 copying build/lib/lm_eval/tasks/careqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,954 copying build/lib/lm_eval/tasks/careqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,956 copying build/lib/lm_eval/tasks/careqa/careqa_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,958 copying build/lib/lm_eval/tasks/careqa/careqa_open_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,959 copying build/lib/lm_eval/tasks/careqa/utils_open.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/careqa 2026-09-01T00:16:40,962 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/piqa 2026-09-01T00:16:40,963 copying build/lib/lm_eval/tasks/piqa/piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2026-09-01T00:16:40,964 copying build/lib/lm_eval/tasks/piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2026-09-01T00:16:40,967 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa 2026-09-01T00:16:40,970 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,971 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,973 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,975 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,977 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/_global_piqa_parallel_generation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,980 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,981 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,983 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,985 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,987 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,989 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,990 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,992 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,994 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,995 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,997 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:40,999 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,000 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,002 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,004 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,006 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,008 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,010 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,011 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,013 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,015 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mag_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,017 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,019 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,021 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,022 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,024 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,026 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,028 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/xho_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,029 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,031 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,033 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,034 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,036 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,038 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,039 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,041 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,042 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,044 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,046 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,047 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,049 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,051 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,053 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,055 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,056 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,058 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,060 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,062 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,064 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,065 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,067 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,068 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,070 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,072 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,073 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,076 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,078 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,079 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,081 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,083 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,085 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,086 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,088 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,090 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,092 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,094 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,096 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,098 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,099 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,101 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ceb_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,103 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,105 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,106 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,108 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,110 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,112 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,113 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,115 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,117 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,119 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,120 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,122 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,124 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,126 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,128 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,130 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,131 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,133 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,135 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,137 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,139 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,141 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,142 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,144 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,146 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,147 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,149 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,151 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,152 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/bxr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,154 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,155 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,157 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,159 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,160 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,162 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,164 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,166 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,167 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,169 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,171 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,173 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,174 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,176 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,178 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,180 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,181 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,183 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,185 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,187 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,188 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,190 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,192 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,194 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,196 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,198 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,200 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,202 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,204 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,205 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,207 copying build/lib/lm_eval/tasks/global_piqa/parallel_generation/ilo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_generation 2026-09-01T00:16:41,209 copying build/lib/lm_eval/tasks/global_piqa/_global_piqa_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-09-01T00:16:41,213 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,215 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,217 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,219 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,221 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,223 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,225 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,227 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,228 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,230 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,232 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,233 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,235 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,237 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,238 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,240 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,242 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,244 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,245 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,247 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,249 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,251 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,253 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,254 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,256 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,258 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,260 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,262 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,264 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,265 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,267 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,269 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,270 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,272 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,274 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,276 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,278 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,279 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,281 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,283 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,284 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,286 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,288 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,290 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,292 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,294 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,296 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,297 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,299 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,301 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,303 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,305 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,306 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,308 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,310 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,312 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,313 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,315 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,317 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,318 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,320 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,322 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/_global_piqa_nonparallel_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,324 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,326 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,327 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,329 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,331 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,333 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/sun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,334 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,336 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,338 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,340 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,342 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,343 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,345 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,346 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,348 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,349 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,351 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,353 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,354 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,356 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,357 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,359 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,361 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,362 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,365 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,367 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,368 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,370 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,372 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,373 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,376 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,377 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,379 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,381 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,383 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,384 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,386 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,387 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/dje_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,389 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,391 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,393 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,394 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,396 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,397 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,399 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,401 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,402 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,404 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,406 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/btx_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,407 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,409 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,411 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,413 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,415 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,416 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,418 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,420 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,422 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,423 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,425 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,427 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,428 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,430 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,431 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,433 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,435 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,436 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,438 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,440 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,441 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,443 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,445 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,447 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,448 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,450 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,452 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,454 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,456 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_cloze 2026-09-01T00:16:41,457 copying build/lib/lm_eval/tasks/global_piqa/_global_piqa_generation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-09-01T00:16:41,459 copying build/lib/lm_eval/tasks/global_piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa 2026-09-01T00:16:41,464 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,465 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,466 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,468 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,470 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,471 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,473 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,475 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,476 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,478 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,480 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,482 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,483 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,485 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,487 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,489 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,491 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,492 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,494 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,496 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,498 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,500 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,501 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,503 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,505 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mag_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,506 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,508 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,510 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,511 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,513 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,515 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,517 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/xho_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,518 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,520 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,522 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,523 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,525 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,527 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,529 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,531 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,532 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,534 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,536 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,538 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,540 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,541 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,543 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,544 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,546 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,548 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,549 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,551 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,553 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,555 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,556 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,558 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,560 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,561 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,563 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,566 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,568 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,570 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,572 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,573 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,575 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,577 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,579 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,581 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,582 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,584 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,586 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,588 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,589 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,591 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ceb_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,593 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,595 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,596 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,598 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,600 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,601 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,603 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,605 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,607 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,608 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,610 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,612 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,614 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,616 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,617 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,619 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,621 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,623 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,625 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,626 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,628 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,629 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,631 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,633 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,634 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,636 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,638 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,639 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,641 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/bxr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,643 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,645 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,647 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,648 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,650 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,652 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,654 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,656 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,657 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,659 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,661 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,663 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,665 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,666 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,668 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,670 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,672 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,673 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,675 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,677 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,679 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,681 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,682 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,684 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,686 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,687 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,689 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,691 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,693 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/_global_piqa_parallel_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,695 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,697 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,699 copying build/lib/lm_eval/tasks/global_piqa/parallel_cloze/ilo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/parallel_cloze 2026-09-01T00:16:41,703 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,704 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ben_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,706 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cat_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,708 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ita_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,709 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/vie_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,711 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ell_grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,712 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ary_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,714 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ckb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,716 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_fran.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,718 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ars_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,719 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/afb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,721 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mar_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,723 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mni_mtei.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,724 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tam_taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,726 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kaz_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,728 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,729 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/eus_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,731 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/acm_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,733 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/snd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,735 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tel_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,736 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pan_guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,738 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bel_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,740 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/jav_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,742 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/zul_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,743 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,745 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/swe_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,747 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,748 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kor_hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,750 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ces_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,752 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/yue_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,753 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,755 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ekk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,757 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,758 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/heb_hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,760 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,761 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bsk_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,763 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/snd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,764 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/als_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,766 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/npi_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,768 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bgc_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,769 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tel_telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,771 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,773 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ekp_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,775 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/lin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,776 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/azj_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,778 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn_sari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,780 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/luo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,782 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/isl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,783 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,785 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/asm_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,786 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hrv_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,788 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nno_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,790 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/arb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,792 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ckm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,793 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/urd_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,795 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nob_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,797 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ron_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,798 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nld_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,800 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/yor_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,802 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,803 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mkd_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,805 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fao_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,807 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hye_armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,809 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/rus_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,811 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/_global_piqa_nonparallel_generation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,813 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,815 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,817 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/sun_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,818 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tha_thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,820 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bul_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,822 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hau_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,824 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bra_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,825 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl_torl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,827 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kir_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,829 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bcc_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,830 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/swv_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,832 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/swh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,834 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/arq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,835 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/plt_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,837 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/haw_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,839 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/dhd_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,840 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/glg_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,842 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mni_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,844 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_leba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,846 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ibo_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,847 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ben_beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,849 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/zsm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,851 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kat_geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,853 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ory_orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,854 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/mal_mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,856 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bho_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,857 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_jord.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,859 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/aeb_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,861 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/iso_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,862 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_port.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,864 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/deu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,866 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ind_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,867 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,869 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/eng_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,871 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/dje_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,872 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/jpn_jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,874 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bam_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,876 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/ukr_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,878 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/dan_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,880 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_syri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,882 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/lit_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,883 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/guj_gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,885 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/sin_sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,887 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/urh_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,889 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/cls_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,891 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/btx_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,892 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_mexi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,894 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_pale.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,896 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tur_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,898 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,899 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/hin_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,901 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_prle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,903 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/bos_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,905 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_spai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,907 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pes_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,909 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/kan_knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,910 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/arz_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,912 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/uzn_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,914 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/tgl_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,916 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_cana.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,918 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/amh_ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,919 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/nag_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,921 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,923 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_cerk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,925 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_peru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,927 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/idu_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,929 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/sin_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,930 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/urd_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,932 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pcm_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,933 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/rwr_deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,935 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/uig_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,937 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_braz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,939 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/pol_latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,941 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/acq_arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,943 copying build/lib/lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/global_piqa/nonparallel_generation 2026-09-01T00:16:41,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/drop 2026-09-01T00:16:41,946 copying build/lib/lm_eval/tasks/drop/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-09-01T00:16:41,949 copying build/lib/lm_eval/tasks/drop/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-09-01T00:16:41,951 copying build/lib/lm_eval/tasks/drop/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2026-09-01T00:16:41,953 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/storycloze 2026-09-01T00:16:41,954 copying build/lib/lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-09-01T00:16:41,956 copying build/lib/lm_eval/tasks/storycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-09-01T00:16:41,958 copying build/lib/lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2026-09-01T00:16:41,960 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nq_open 2026-09-01T00:16:41,961 copying build/lib/lm_eval/tasks/nq_open/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2026-09-01T00:16:41,963 copying build/lib/lm_eval/tasks/nq_open/nq_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2026-09-01T00:16:41,965 copying build/lib/lm_eval/tasks/_factory.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2026-09-01T00:16:41,968 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/indicparam 2026-09-01T00:16:41,969 copying build/lib/lm_eval/tasks/indicparam/indicparam_oriya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,971 copying build/lib/lm_eval/tasks/indicparam/indicparam_rajasthani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,973 copying build/lib/lm_eval/tasks/indicparam/_indicparam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,975 copying build/lib/lm_eval/tasks/indicparam/indicparam_gujarati.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,977 copying build/lib/lm_eval/tasks/indicparam/indicparam_sanskrit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,979 copying build/lib/lm_eval/tasks/indicparam/indicparam_dogri.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,980 copying build/lib/lm_eval/tasks/indicparam/indicparam_santali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,982 copying build/lib/lm_eval/tasks/indicparam/indicparam_sanskrit_mix.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,984 copying build/lib/lm_eval/tasks/indicparam/indicparam_maithili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,986 copying build/lib/lm_eval/tasks/indicparam/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,987 copying build/lib/lm_eval/tasks/indicparam/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,989 copying build/lib/lm_eval/tasks/indicparam/indicparam_konkani.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,991 copying build/lib/lm_eval/tasks/indicparam/indicparam_bodo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,993 copying build/lib/lm_eval/tasks/indicparam/_default_indicparam_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,995 copying build/lib/lm_eval/tasks/indicparam/indicparam_nepali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,997 copying build/lib/lm_eval/tasks/indicparam/indicparam_marathi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/indicparam 2026-09-01T00:16:41,999 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,000 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,002 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,004 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_biorxiv_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,006 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,008 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,010 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,012 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_nonenglish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,014 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_bbc_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,015 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_markdown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,017 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_nonenglish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,020 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_cpp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,021 copying build/lib/lm_eval/tasks/uncheatable_eval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,023 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,025 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,027 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,029 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,031 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_cs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,032 copying build/lib/lm_eval/tasks/uncheatable_eval/_uncheatable_eval_base.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,034 copying build/lib/lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/uncheatable_eval 2026-09-01T00:16:42,036 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:16:42,038 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:16:42,040 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish 2026-09-01T00:16:42,043 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,044 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,046 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,048 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,050 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,052 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,054 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,056 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,058 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,059 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,061 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,063 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,065 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,067 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,069 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,071 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,073 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,074 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,076 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,078 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,079 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,081 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,083 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,085 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,086 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,088 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,090 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,092 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,094 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,095 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,097 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,099 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,101 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,103 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,105 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,107 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,109 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,111 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,112 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,114 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,116 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,118 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,119 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,121 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,123 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,125 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,126 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,128 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,130 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,132 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,133 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,135 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,137 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,139 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,140 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,142 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,144 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,146 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,147 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,149 copying build/lib/lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu-redux-spanish/generative 2026-09-01T00:16:42,152 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:42,153 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:42,156 copying build/lib/lm_eval/tasks/mediqa_qa2019/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:42,158 copying build/lib/lm_eval/tasks/mediqa_qa2019/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:42,160 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:42,163 copying build/lib/lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mediqa_qa2019 2026-09-01T00:16:42,166 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/webqs 2026-09-01T00:16:42,167 copying build/lib/lm_eval/tasks/webqs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-09-01T00:16:42,170 copying build/lib/lm_eval/tasks/webqs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-09-01T00:16:42,172 copying build/lib/lm_eval/tasks/webqs/webqs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2026-09-01T00:16:42,175 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm_plus 2026-09-01T00:16:42,177 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-09-01T00:16:42,179 copying build/lib/lm_eval/tasks/gsm_plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-09-01T00:16:42,181 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2026-09-01T00:16:42,184 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa2 2026-09-01T00:16:42,186 copying build/lib/lm_eval/tasks/logiqa2/logieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:16:42,188 copying build/lib/lm_eval/tasks/logiqa2/logiqa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:16:42,190 copying build/lib/lm_eval/tasks/logiqa2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:16:42,193 copying build/lib/lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2026-09-01T00:16:42,196 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench 2026-09-01T00:16:42,198 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr 2026-09-01T00:16:42,199 copying build/lib/lm_eval/tasks/afrobench/adr/afridiacritics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-09-01T00:16:42,201 copying build/lib/lm_eval/tasks/afrobench/adr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-09-01T00:16:42,204 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,206 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,208 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,210 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,212 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,214 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,216 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_1 2026-09-01T00:16:42,219 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,220 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,222 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,225 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,227 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,229 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,232 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_4 2026-09-01T00:16:42,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,236 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,238 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,240 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,242 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,245 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,247 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_3 2026-09-01T00:16:42,249 copying build/lib/lm_eval/tasks/afrobench/adr/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr 2026-09-01T00:16:42,252 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,253 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,255 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,257 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,258 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,260 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,262 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_5 2026-09-01T00:16:42,264 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,265 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,267 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,269 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,271 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,273 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,274 copying build/lib/lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/adr/prompt_2 2026-09-01T00:16:42,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:16:42,278 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:16:42,280 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:16:42,282 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,283 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,285 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,287 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,289 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,291 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,292 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,294 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,296 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,298 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1 2026-09-01T00:16:42,300 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,301 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,303 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,305 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,307 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,308 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,310 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,312 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,313 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,315 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4 2026-09-01T00:16:42,317 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy 2026-09-01T00:16:42,320 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,321 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,323 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,324 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,326 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,328 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,330 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,332 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,333 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,335 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3 2026-09-01T00:16:42,338 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,339 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,341 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,342 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,344 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,346 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,347 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,349 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,351 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,353 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5 2026-09-01T00:16:42,355 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,356 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,358 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,359 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,361 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,363 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,365 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,366 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,368 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,370 copying build/lib/lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2 2026-09-01T00:16:42,372 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt 2026-09-01T00:16:42,373 copying build/lib/lm_eval/tasks/afrobench/salt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-09-01T00:16:42,376 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,377 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,379 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,380 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,382 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,384 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,385 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,387 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,389 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,391 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,392 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,394 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,396 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,398 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,400 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,402 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_1 2026-09-01T00:16:42,404 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,405 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,407 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,409 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,411 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,413 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,415 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,416 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,418 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,420 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,422 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,423 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,425 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,427 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,428 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,430 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_3 2026-09-01T00:16:42,432 copying build/lib/lm_eval/tasks/afrobench/salt/salt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-09-01T00:16:42,434 copying build/lib/lm_eval/tasks/afrobench/salt/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt 2026-09-01T00:16:42,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,437 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,439 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,441 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,443 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,445 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,447 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,448 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,450 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,452 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,454 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,457 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,459 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,461 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,463 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,465 copying build/lib/lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/salt/prompt_2 2026-09-01T00:16:42,468 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele 2026-09-01T00:16:42,470 copying build/lib/lm_eval/tasks/afrobench/belebele/belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-09-01T00:16:42,472 copying build/lib/lm_eval/tasks/afrobench/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-09-01T00:16:42,475 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,477 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,479 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,481 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,483 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,486 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,488 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,491 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,493 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,495 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,498 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,500 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,503 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,505 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,507 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,509 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,512 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,514 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,516 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,518 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,520 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,523 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,525 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,527 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,528 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,530 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,532 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,534 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,536 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,538 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,540 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,541 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,543 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_1 2026-09-01T00:16:42,546 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,547 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,549 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,551 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,553 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,555 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,557 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,559 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,560 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,562 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,564 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,566 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,567 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,569 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,571 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,572 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,574 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,576 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,578 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,579 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,581 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,583 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,585 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,587 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,588 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,590 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,592 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,593 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,595 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,597 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,599 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,601 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,603 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_4 2026-09-01T00:16:42,605 copying build/lib/lm_eval/tasks/afrobench/belebele/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele 2026-09-01T00:16:42,608 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,609 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,611 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,612 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,614 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,616 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,619 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,621 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,622 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,624 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,626 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,628 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,630 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,632 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,634 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,636 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,638 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,640 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,642 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,644 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,646 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,648 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,650 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,651 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,653 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,655 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,657 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,659 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,661 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,662 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,664 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,666 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,669 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_3 2026-09-01T00:16:42,672 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,673 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,675 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,677 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,679 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,680 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,682 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,684 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,686 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,688 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,690 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,692 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,694 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,696 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,698 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,699 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,701 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,703 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,705 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,706 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,708 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,710 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,712 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,713 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,715 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,717 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,719 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,720 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,722 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,724 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,726 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,727 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,729 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_5 2026-09-01T00:16:42,732 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,733 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,735 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,737 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,738 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,740 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,742 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,743 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,745 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,747 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,749 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,750 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,753 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,754 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,756 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,758 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,760 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,762 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,764 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,766 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,767 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,769 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,771 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,773 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,775 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,777 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,779 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,780 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,782 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,784 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,786 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,788 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,789 copying build/lib/lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/belebele/prompt_2 2026-09-01T00:16:42,792 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:16:42,793 copying build/lib/lm_eval/tasks/afrobench/masakhapos/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:16:42,796 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,797 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,799 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,801 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,802 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,804 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,806 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,808 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,810 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,811 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,813 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,815 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,817 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,819 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,821 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,822 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,824 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,826 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,828 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,829 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,831 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,833 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,835 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_1 2026-09-01T00:16:42,837 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,838 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,840 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,842 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,844 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,846 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,848 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,850 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,852 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,853 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,856 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,858 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,860 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,861 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,863 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,865 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,867 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,868 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,870 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,872 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,874 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,876 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,878 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_4 2026-09-01T00:16:42,879 copying build/lib/lm_eval/tasks/afrobench/masakhapos/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:16:42,882 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,883 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,885 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,887 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,889 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,891 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,893 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,894 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,897 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,898 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,900 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,902 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,904 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,906 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,907 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,909 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,911 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,913 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,915 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,917 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,919 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,921 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,922 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_3 2026-09-01T00:16:42,924 copying build/lib/lm_eval/tasks/afrobench/masakhapos/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:16:42,927 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,928 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,930 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,932 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,934 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,936 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,937 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,939 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,941 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,943 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,945 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,947 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,949 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,951 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,953 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,954 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,957 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,959 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,961 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,963 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,966 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,968 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,970 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_5 2026-09-01T00:16:42,972 copying build/lib/lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos 2026-09-01T00:16:42,975 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,977 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,979 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,981 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,983 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,986 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,988 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,990 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,992 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,994 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,996 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:42,998 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,000 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,002 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,004 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,006 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,008 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,010 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,012 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,014 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,016 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,019 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,021 copying build/lib/lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhapos/prompt_2 2026-09-01T00:16:43,024 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent 2026-09-01T00:16:43,025 copying build/lib/lm_eval/tasks/afrobench/injongointent/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-09-01T00:16:43,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,029 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,032 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,034 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,037 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,039 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,041 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,043 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,046 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,048 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,050 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,052 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,055 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,057 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,058 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,060 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,062 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,064 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,066 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,068 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_1 2026-09-01T00:16:43,069 copying build/lib/lm_eval/tasks/afrobench/injongointent/injongointent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-09-01T00:16:43,072 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,073 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,075 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,076 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,078 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,080 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,082 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,083 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,085 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,086 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,088 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,090 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,091 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,093 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,095 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,096 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,098 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,100 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,101 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,103 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_4 2026-09-01T00:16:43,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,106 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,108 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,110 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,112 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,113 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,115 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,117 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,119 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,120 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,122 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,124 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,126 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,127 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,129 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,131 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,133 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,135 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,137 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,139 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_3 2026-09-01T00:16:43,141 copying build/lib/lm_eval/tasks/afrobench/injongointent/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent 2026-09-01T00:16:43,144 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,145 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,147 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,149 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,151 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,153 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,155 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,157 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,159 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,161 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,162 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,164 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,166 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,168 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,170 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,171 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,173 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,175 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,177 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,179 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_5 2026-09-01T00:16:43,181 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,182 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,184 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,186 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,188 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,190 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,192 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,193 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,195 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,197 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,199 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,200 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,202 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,204 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,205 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,207 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,209 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,210 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,212 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,214 copying build/lib/lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/injongointent/prompt_2 2026-09-01T00:16:43,217 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:16:43,218 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:16:43,219 copying build/lib/lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sample_run_scripts 2026-09-01T00:16:43,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:16:43,223 copying build/lib/lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:16:43,225 copying build/lib/lm_eval/tasks/afrobench/masakhanews/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:16:43,228 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,229 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,231 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,233 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,235 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,237 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,238 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,240 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,242 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,243 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,245 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,247 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,248 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,250 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,252 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,254 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,255 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,257 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,259 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_1 2026-09-01T00:16:43,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,262 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,264 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,266 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,268 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,270 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,271 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,273 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,275 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,276 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,278 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,279 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,281 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,283 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,284 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,286 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,288 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,289 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,291 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_4 2026-09-01T00:16:43,293 copying build/lib/lm_eval/tasks/afrobench/masakhanews/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews 2026-09-01T00:16:43,296 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,297 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,299 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,300 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,302 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,304 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,306 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,308 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,310 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,311 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,313 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,315 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,316 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,318 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,320 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,321 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,323 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,325 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,327 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_3 2026-09-01T00:16:43,329 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,330 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,332 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,334 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,335 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,337 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,339 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,341 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,343 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,344 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,346 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,348 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,350 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,351 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,353 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,355 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,356 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,358 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,360 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_5 2026-09-01T00:16:43,362 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,363 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,365 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,367 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,369 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,371 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,373 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,375 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,377 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,379 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,381 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,383 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,385 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,386 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,388 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,390 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,392 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,394 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,395 copying build/lib/lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhanews/prompt_2 2026-09-01T00:16:43,397 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa 2026-09-01T00:16:43,398 copying build/lib/lm_eval/tasks/afrobench/afriqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-09-01T00:16:43,401 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,402 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,404 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,406 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,408 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,409 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,411 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,413 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,415 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,417 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,418 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,420 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_1 2026-09-01T00:16:43,422 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,423 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,425 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,427 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,429 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,431 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,432 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,434 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,436 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,438 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,440 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,441 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_4 2026-09-01T00:16:43,443 copying build/lib/lm_eval/tasks/afrobench/afriqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-09-01T00:16:43,446 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,447 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,448 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,450 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,452 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,453 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,455 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,457 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,459 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,460 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,462 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,464 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_3 2026-09-01T00:16:43,466 copying build/lib/lm_eval/tasks/afrobench/afriqa/afriqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa 2026-09-01T00:16:43,468 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,469 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,471 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,473 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,475 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,477 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,479 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,481 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,482 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,484 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,486 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,488 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_5 2026-09-01T00:16:43,490 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,491 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,493 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,495 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,497 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,498 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,500 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,502 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,504 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,506 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,508 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,510 copying build/lib/lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afriqa/prompt_2 2026-09-01T00:16:43,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand 2026-09-01T00:16:43,513 copying build/lib/lm_eval/tasks/afrobench/mafand/mafand.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-09-01T00:16:43,515 copying build/lib/lm_eval/tasks/afrobench/mafand/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-09-01T00:16:43,518 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1 2026-09-01T00:16:43,520 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,521 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,523 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,525 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,527 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,529 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,531 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,533 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,535 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,537 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,538 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,540 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,542 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,543 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,545 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,547 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,549 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,551 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,553 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,555 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,557 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,559 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,560 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,562 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/english-african 2026-09-01T00:16:43,565 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,566 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,568 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,569 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,571 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,573 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,574 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,576 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,578 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,580 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,582 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,584 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,586 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,588 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,590 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,592 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,594 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,595 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,597 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,599 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,601 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,603 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,604 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,606 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_1/african-english 2026-09-01T00:16:43,609 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3 2026-09-01T00:16:43,610 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,611 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,613 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,615 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,617 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,619 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,620 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,622 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,624 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,626 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,628 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,630 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,631 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,633 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,635 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,637 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,639 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,641 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,642 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,644 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,646 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,648 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,649 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,651 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/english-african 2026-09-01T00:16:43,654 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,656 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,658 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,659 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,661 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,663 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,665 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,666 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,668 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,670 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,672 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,673 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,675 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,677 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,679 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,680 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,682 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,684 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,686 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,688 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,690 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,691 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,693 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,695 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_3/african-english 2026-09-01T00:16:43,697 copying build/lib/lm_eval/tasks/afrobench/mafand/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand 2026-09-01T00:16:43,700 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2 2026-09-01T00:16:43,702 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,703 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,705 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,706 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,708 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,710 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,712 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,713 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,715 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,717 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,718 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,720 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,722 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,724 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,725 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,727 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,729 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,731 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,733 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,735 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,737 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,739 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,741 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,743 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/english-african 2026-09-01T00:16:43,745 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,746 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,748 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,750 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,751 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,753 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,755 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,757 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,759 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,760 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,762 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,764 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,766 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,768 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,770 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,772 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,773 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,775 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,777 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,779 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,781 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,783 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,785 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,787 copying build/lib/lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/mafand/prompt_2/african-english 2026-09-01T00:16:43,790 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:43,791 copying build/lib/lm_eval/tasks/afrobench/afrisenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:43,793 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,794 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,796 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,798 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,800 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,801 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,803 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,805 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,807 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,809 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,810 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,812 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,814 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,816 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,818 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,819 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,821 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,823 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,825 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_1 2026-09-01T00:16:43,827 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,828 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,830 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,832 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,833 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,835 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,837 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,839 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,840 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,842 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,844 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,846 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,848 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,850 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,851 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,853 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,855 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,856 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_4 2026-09-01T00:16:43,858 copying build/lib/lm_eval/tasks/afrobench/afrisenti/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:43,861 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,862 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,864 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,866 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,868 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,869 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,871 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,873 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,875 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,876 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,878 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,880 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,881 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,883 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,885 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,887 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,888 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,890 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_3 2026-09-01T00:16:43,892 copying build/lib/lm_eval/tasks/afrobench/afrisenti/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:43,894 copying build/lib/lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti 2026-09-01T00:16:43,897 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,898 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,900 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,902 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,904 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,906 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,907 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,909 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,911 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,912 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,914 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,916 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,917 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,919 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,921 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,923 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,924 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,926 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_5 2026-09-01T00:16:43,929 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,930 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,931 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,933 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,935 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,937 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,938 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,940 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,942 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,943 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,945 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,947 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,948 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,950 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,951 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,953 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,955 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,956 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,958 copying build/lib/lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/afrisenti/prompt_2 2026-09-01T00:16:43,960 copying build/lib/lm_eval/tasks/afrobench/afrobench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-09-01T00:16:43,962 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex 2026-09-01T00:16:43,963 copying build/lib/lm_eval/tasks/afrobench/ntrex/ntrex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-09-01T00:16:43,965 copying build/lib/lm_eval/tasks/afrobench/ntrex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-09-01T00:16:43,967 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1 2026-09-01T00:16:43,969 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,970 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,972 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,974 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,976 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,977 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,979 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,981 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,983 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,984 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,986 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,988 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,989 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,991 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,993 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,995 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,997 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:43,998 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,000 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,002 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,003 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,005 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,007 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,009 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,010 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,012 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,014 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,015 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,017 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,019 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,021 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,022 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,024 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,026 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/english-african 2026-09-01T00:16:44,028 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,029 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,031 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,033 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,035 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,037 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,038 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,040 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,042 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,044 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,046 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,047 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,049 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,051 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,053 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,054 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,056 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,058 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,059 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,061 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,063 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,065 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,066 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,068 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,070 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,072 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,074 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,075 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,077 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,079 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,081 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,083 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,086 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,088 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_1/african-english 2026-09-01T00:16:44,090 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3 2026-09-01T00:16:44,092 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,093 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,095 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,097 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,099 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,101 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,103 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,105 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,107 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,109 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,111 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,112 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,114 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,117 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,119 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,120 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,122 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,124 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,125 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,127 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,129 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,130 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,132 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,134 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,136 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,137 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,139 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,141 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,143 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,145 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,146 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,148 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,150 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,152 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/english-african 2026-09-01T00:16:44,155 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,156 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,158 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,159 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,161 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,163 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,165 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,167 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,169 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,171 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,173 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,175 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,177 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,179 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,181 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,182 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,184 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,186 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,188 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,190 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,192 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,194 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,196 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,198 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,200 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,202 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,204 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,206 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,208 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,210 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,212 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,214 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,216 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,217 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_3/african-english 2026-09-01T00:16:44,219 copying build/lib/lm_eval/tasks/afrobench/ntrex/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex 2026-09-01T00:16:44,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2 2026-09-01T00:16:44,224 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,225 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,228 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,230 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,232 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,234 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,235 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,237 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,239 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,241 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,242 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,244 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,246 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,248 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,250 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,251 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,253 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,255 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,257 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,258 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,260 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,262 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,264 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,266 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,267 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,269 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,271 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,272 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,274 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,276 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,278 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,279 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,281 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,283 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/english-african 2026-09-01T00:16:44,286 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,287 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,288 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,290 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,292 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,294 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,295 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,297 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,299 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,301 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,302 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,304 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,305 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,307 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,309 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,311 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,312 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,314 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,316 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,317 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,319 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,321 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,322 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,324 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,326 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,328 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,329 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,331 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,333 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,334 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,336 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,338 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,339 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,341 copying build/lib/lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/ntrex/prompt_2/african-english 2026-09-01T00:16:44,342 copying build/lib/lm_eval/tasks/afrobench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-09-01T00:16:44,345 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:16:44,346 copying build/lib/lm_eval/tasks/afrobench/nollysenti/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:16:44,349 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,350 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,351 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,353 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,355 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,357 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,358 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,360 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_1 2026-09-01T00:16:44,362 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,363 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,365 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,367 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,369 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,371 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,372 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,374 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_4 2026-09-01T00:16:44,376 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,377 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,379 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,381 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,382 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,384 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,386 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,388 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_3 2026-09-01T00:16:44,389 copying build/lib/lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti 2026-09-01T00:16:44,392 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,393 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,395 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,396 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,398 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,400 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,401 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,403 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_5 2026-09-01T00:16:44,405 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,406 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,408 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,410 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,412 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,413 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,415 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,417 copying build/lib/lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/nollysenti/prompt_2 2026-09-01T00:16:44,419 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores 2026-09-01T00:16:44,420 copying build/lib/lm_eval/tasks/afrobench/flores/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-09-01T00:16:44,423 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1 2026-09-01T00:16:44,425 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,426 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,428 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,430 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,431 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,433 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,435 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,437 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,438 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,440 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,442 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,444 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,446 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,447 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,449 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,451 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,452 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,454 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,455 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,457 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,459 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,460 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,462 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,464 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,465 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,467 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,469 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,470 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,472 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,474 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,475 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,477 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,479 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,481 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,482 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,484 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,486 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,487 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,489 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,490 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,492 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,494 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,495 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,497 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,499 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,501 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,502 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,504 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,506 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,508 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,510 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,511 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,513 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,514 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,516 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,518 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,520 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,521 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,523 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,525 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,526 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,528 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,530 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,531 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/english-african 2026-09-01T00:16:44,535 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,536 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,537 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,539 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,541 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,543 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,545 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,547 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,548 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,550 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,552 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,553 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,555 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,557 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,559 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,560 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,562 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,564 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,566 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,567 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,569 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,571 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,573 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,575 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,576 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,578 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,580 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,581 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,583 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,588 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,590 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,592 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,593 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,595 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,597 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,599 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,600 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,602 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,604 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,606 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,608 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,610 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,612 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,613 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,615 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,616 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,618 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,620 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,621 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,623 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,625 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,626 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,628 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,630 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,632 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,633 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,635 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,637 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,639 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,640 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,642 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,644 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,646 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,647 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1/african-english 2026-09-01T00:16:44,649 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_1/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_1 2026-09-01T00:16:44,651 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3 2026-09-01T00:16:44,653 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,654 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,656 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,658 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,660 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,662 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,663 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,665 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,667 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,669 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,670 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,672 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,674 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,676 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,678 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,679 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,681 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,682 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,684 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,686 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,688 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,689 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,691 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,693 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,694 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,696 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,698 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,700 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,702 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,703 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,705 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,707 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,708 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,710 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,712 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,713 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,715 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,717 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,718 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,720 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,722 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,723 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,725 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,727 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,729 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,730 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,732 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,734 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,736 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,737 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,739 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,741 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,743 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,744 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,746 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,748 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,749 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,751 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,753 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,754 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,756 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,758 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,760 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,762 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/english-african 2026-09-01T00:16:44,765 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,766 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,768 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,769 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,771 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,773 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,775 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,777 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,778 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,780 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,781 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,783 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,785 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,786 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,788 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,790 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,792 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,793 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,795 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,797 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,799 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,800 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,802 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,804 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,806 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,807 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,809 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,811 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,813 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,814 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,816 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,818 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,819 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,821 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,823 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,824 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,826 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,828 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,830 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,832 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,833 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,835 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,837 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,839 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,840 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,842 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,844 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,845 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,847 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,849 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,850 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,852 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,854 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,856 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,858 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,860 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,862 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,863 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,865 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,867 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,869 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,871 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,872 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,874 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3/african-english 2026-09-01T00:16:44,876 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_3/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_3 2026-09-01T00:16:44,877 copying build/lib/lm_eval/tasks/afrobench/flores/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-09-01T00:16:44,879 copying build/lib/lm_eval/tasks/afrobench/flores/flores.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores 2026-09-01T00:16:44,881 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2 2026-09-01T00:16:44,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,885 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,886 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,888 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,890 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,892 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,893 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,895 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,897 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,899 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,900 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,902 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,904 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,906 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,908 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,909 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,911 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,913 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,915 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,917 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,918 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,920 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,922 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,923 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,925 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,927 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,929 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,931 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,933 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,934 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,936 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,938 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,939 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,941 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,943 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,944 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,946 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,948 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,950 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,951 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,953 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,955 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,957 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,958 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,960 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,962 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,964 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,965 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,967 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,969 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,971 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,972 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,974 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,976 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,978 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,979 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,981 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,983 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,985 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,986 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,988 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,990 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,992 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,993 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/english-african 2026-09-01T00:16:44,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:44,998 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:44,999 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,001 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,003 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,005 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,006 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,008 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,010 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,011 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,013 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,014 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,016 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,018 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,019 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,021 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,023 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,024 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,026 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,028 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,030 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,031 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,033 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,035 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,037 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,039 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,041 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,042 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,044 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,046 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,048 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,050 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,051 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,053 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,055 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,057 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,058 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,060 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,062 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,064 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,066 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,068 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,070 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,071 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,073 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,075 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,077 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,078 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,080 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,082 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,083 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,085 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,087 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,089 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,091 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,092 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,094 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,096 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,098 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,100 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,102 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,103 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,105 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,107 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2/african-english 2026-09-01T00:16:45,109 copying build/lib/lm_eval/tasks/afrobench/flores/prompt_2/flores -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/flores/prompt_2 2026-09-01T00:16:45,111 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc 2026-09-01T00:16:45,112 copying build/lib/lm_eval/tasks/afrobench/naijarc/naijarc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-09-01T00:16:45,114 copying build/lib/lm_eval/tasks/afrobench/naijarc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-09-01T00:16:45,117 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:45,118 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:45,120 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:45,121 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:45,123 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_1 2026-09-01T00:16:45,126 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:45,127 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:45,129 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:45,130 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:45,132 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_4 2026-09-01T00:16:45,134 copying build/lib/lm_eval/tasks/afrobench/naijarc/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc 2026-09-01T00:16:45,136 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:45,137 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:45,139 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:45,141 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:45,143 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_3 2026-09-01T00:16:45,146 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:45,147 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:45,149 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:45,151 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:45,152 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_5 2026-09-01T00:16:45,155 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:45,156 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:45,158 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:45,159 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:45,161 copying build/lib/lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/naijarc/prompt_2 2026-09-01T00:16:45,163 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:16:45,164 copying build/lib/lm_eval/tasks/afrobench/masakhaner/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:16:45,167 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,168 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,170 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,172 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,174 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,175 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,177 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,179 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,180 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,182 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,184 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,186 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,188 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,190 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,191 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,193 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,195 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,197 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,198 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,200 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,202 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,204 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,205 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_1 2026-09-01T00:16:45,207 copying build/lib/lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:16:45,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,211 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,213 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,214 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,216 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,218 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,220 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,222 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,224 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,225 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,227 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,230 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,231 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,233 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,235 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,237 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,239 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,241 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,242 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,244 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,246 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,247 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,249 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_4 2026-09-01T00:16:45,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,252 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,254 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,256 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,258 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,259 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,261 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,263 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,264 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,266 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,268 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,270 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,272 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,274 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,276 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,278 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,279 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,281 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,283 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,285 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,286 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,288 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,290 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_3 2026-09-01T00:16:45,292 copying build/lib/lm_eval/tasks/afrobench/masakhaner/gen_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner 2026-09-01T00:16:45,295 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,296 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,297 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,299 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,301 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,303 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,305 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,306 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,308 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,310 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,312 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,314 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,316 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,317 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,319 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,321 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,323 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,324 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,326 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,328 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,330 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,331 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,333 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_5 2026-09-01T00:16:45,336 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,337 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,339 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,341 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,342 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,344 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,346 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,348 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,350 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,351 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,353 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,355 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,357 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,359 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,361 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,363 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,364 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,366 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,368 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,370 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,372 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,374 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,375 copying build/lib/lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/masakhaner/prompt_2 2026-09-01T00:16:45,378 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:16:45,379 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:16:45,381 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:16:45,383 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:45,384 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:45,386 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:45,387 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:45,389 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_1 2026-09-01T00:16:45,391 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:45,392 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:45,394 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:45,396 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:45,398 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_4 2026-09-01T00:16:45,400 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu 2026-09-01T00:16:45,402 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:45,403 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:45,405 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:45,406 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:45,408 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_3 2026-09-01T00:16:45,410 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:45,411 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:45,413 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:45,415 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:45,417 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_5 2026-09-01T00:16:45,419 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:45,420 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:45,422 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:45,424 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:45,426 copying build/lib/lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/openai_mmlu/prompt_2 2026-09-01T00:16:45,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum 2026-09-01T00:16:45,429 copying build/lib/lm_eval/tasks/afrobench/xlsum/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-09-01T00:16:45,432 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,433 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,435 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,437 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,438 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,440 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,442 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,444 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,445 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,447 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,449 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,450 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,452 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,454 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,456 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_1 2026-09-01T00:16:45,457 copying build/lib/lm_eval/tasks/afrobench/xlsum/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-09-01T00:16:45,460 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,461 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,463 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,464 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,466 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,468 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,469 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,471 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,473 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,475 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,477 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,478 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,480 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,482 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,483 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_3 2026-09-01T00:16:45,485 copying build/lib/lm_eval/tasks/afrobench/xlsum/xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum 2026-09-01T00:16:45,487 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,488 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,490 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,492 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,494 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,496 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,497 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,499 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,501 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,503 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,504 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,506 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,508 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,510 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,512 copying build/lib/lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/xlsum/prompt_2 2026-09-01T00:16:45,514 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib 2026-09-01T00:16:45,515 copying build/lib/lm_eval/tasks/afrobench/sib/sib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-09-01T00:16:45,517 copying build/lib/lm_eval/tasks/afrobench/sib/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-09-01T00:16:45,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,522 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,524 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,526 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,527 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,529 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,531 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,532 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,534 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,536 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,537 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,539 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,541 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,542 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,544 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,546 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,548 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,549 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,551 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,553 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,555 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,556 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,558 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,560 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,562 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,563 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,565 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,567 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,568 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,570 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,572 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,573 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,575 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,577 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,578 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,580 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,581 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,583 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,585 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,587 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,589 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,591 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,593 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,596 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,597 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,599 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,601 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,603 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,605 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,607 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,609 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,611 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,613 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,615 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,617 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,619 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,620 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,622 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,624 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_1/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_1 2026-09-01T00:16:45,627 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,628 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,630 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,631 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,633 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,635 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,637 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,638 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,640 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,642 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,644 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,646 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,648 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,649 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,651 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,653 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,655 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,657 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,659 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,660 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,662 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,664 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,666 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,667 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,669 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,671 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,673 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,674 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,676 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,678 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,680 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,682 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,683 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,685 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,687 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,689 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,691 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,692 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,694 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,696 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,698 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,700 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,701 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,703 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,705 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,706 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,709 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,710 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,712 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,714 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,715 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,717 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,719 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,721 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,722 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,724 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,726 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,728 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,729 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_4/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_4 2026-09-01T00:16:45,731 copying build/lib/lm_eval/tasks/afrobench/sib/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib 2026-09-01T00:16:45,735 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,736 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,738 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,739 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,741 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,743 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,745 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,746 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,748 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,750 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,752 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,753 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,755 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,757 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,759 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,760 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,762 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,764 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,766 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,767 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,769 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,771 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,773 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,774 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,777 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,778 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,780 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,782 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,783 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,785 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,787 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,789 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,791 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,792 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,794 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,796 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,798 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,800 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,802 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,804 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,805 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,807 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,809 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,811 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,813 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,815 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,817 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,819 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,820 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,822 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,824 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,826 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,828 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,829 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,831 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,833 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,835 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,836 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,838 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_3/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_3 2026-09-01T00:16:45,841 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,842 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,844 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,846 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,848 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,850 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,852 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,854 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,855 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,857 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,859 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,861 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,862 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,864 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,866 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,868 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,870 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,871 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,873 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,875 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,877 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,879 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,881 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,882 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,884 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,886 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,887 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,889 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,891 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,893 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,895 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,896 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,898 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,900 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,902 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,904 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,905 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,907 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,909 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,911 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,912 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,914 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,916 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,918 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,920 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,922 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,924 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,926 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,927 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,929 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,931 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,932 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,934 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,936 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,938 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,940 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,942 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,944 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,945 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_5/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_5 2026-09-01T00:16:45,949 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,949 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,951 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,953 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,955 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,956 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,958 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,960 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,962 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,963 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,965 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,967 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,969 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,971 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,972 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,974 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,976 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,977 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,979 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,981 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,982 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,984 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,986 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,988 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,990 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,991 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,993 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,995 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,997 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:45,999 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,001 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,002 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,004 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,006 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,008 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,010 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,012 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,014 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,016 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,018 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,020 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,022 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,024 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,026 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,028 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,030 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,032 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,034 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,036 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,038 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,040 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,042 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,044 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,047 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,049 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,051 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,054 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,056 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,058 copying build/lib/lm_eval/tasks/afrobench/sib/prompt_2/sib -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench/sib/prompt_2 2026-09-01T00:16:46,061 copying build/lib/lm_eval/tasks/afrobench/afrobench-lite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrobench 2026-09-01T00:16:46,064 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr 2026-09-01T00:16:46,067 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,068 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,071 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,073 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,075 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,077 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,079 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,081 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,083 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,085 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,087 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,089 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,092 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,094 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,096 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,098 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,101 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,103 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,105 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,107 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,109 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,111 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,113 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,116 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,118 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,120 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,122 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,124 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,126 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,128 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,130 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,132 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,134 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,137 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,138 copying build/lib/lm_eval/tasks/mmlusr/answer_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,140 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,142 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,144 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,145 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,147 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,149 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,151 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,152 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,154 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,156 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,158 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,159 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,161 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,163 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,164 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,166 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,168 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,169 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,171 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,173 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,174 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,176 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,178 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,179 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,181 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,183 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2026-09-01T00:16:46,186 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,187 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,189 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,191 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,192 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,194 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,196 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,198 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,200 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,202 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,203 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,205 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,207 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,209 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,210 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,212 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,214 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,216 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,217 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,219 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,221 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,223 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,224 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,226 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,228 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,230 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,232 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,234 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,236 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,237 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,239 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,241 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,243 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,245 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,246 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,248 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,250 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,252 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,254 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,255 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,257 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,259 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,261 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,263 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,265 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,267 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,269 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,270 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,272 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,274 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,276 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,277 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,279 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,281 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,283 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,285 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,287 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,289 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,290 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,292 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,294 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2026-09-01T00:16:46,297 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,298 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,300 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,302 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,304 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,306 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,308 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,310 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,312 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,314 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,316 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,317 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,319 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,321 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,323 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,324 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,326 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,328 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,330 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,332 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,333 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,335 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,337 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,339 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,341 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,342 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,344 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,346 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,348 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,350 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,352 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,354 copying build/lib/lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,356 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,357 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,359 copying build/lib/lm_eval/tasks/mmlusr/question_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,361 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,363 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,365 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,366 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,368 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,370 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,372 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,373 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,375 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,377 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,379 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,381 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,383 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,385 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,386 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,388 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,390 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,392 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,394 copying build/lib/lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,396 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,398 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,400 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,402 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,403 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,405 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,407 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2026-09-01T00:16:46,409 copying build/lib/lm_eval/tasks/mmlusr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2026-09-01T00:16:46,411 copying build/lib/lm_eval/tasks/mmlusr/config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2026-09-01T00:16:46,413 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval 2026-09-01T00:16:46,414 copying build/lib/lm_eval/tasks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:16:46,417 copying build/lib/lm_eval/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:16:46,420 copying build/lib/lm_eval/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:16:46,423 copying build/lib/lm_eval/tasks/ifeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:16:46,424 copying build/lib/lm_eval/tasks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:16:46,427 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:46,429 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:16:46,430 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:16:46,433 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:16:46,434 copying build/lib/lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instruction_utils 2026-09-01T00:16:46,437 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:46,439 copying build/lib/lm_eval/tasks/ifeval/multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:46,442 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:16:46,443 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:16:46,446 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:16:46,449 copying build/lib/lm_eval/tasks/ifeval/multilingual/instructions/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual/instructions 2026-09-01T00:16:46,451 copying build/lib/lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:46,452 copying build/lib/lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval/multilingual 2026-09-01T00:16:46,454 copying build/lib/lm_eval/tasks/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2026-09-01T00:16:46,457 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench 2026-09-01T00:16:46,458 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:46,459 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:46,461 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:46,463 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:46,465 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:46,466 copying build/lib/lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_summarization 2026-09-01T00:16:46,469 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,470 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,471 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,473 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,475 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,477 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,479 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,480 copying build/lib/lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_transliteration 2026-09-01T00:16:46,482 copying build/lib/lm_eval/tasks/darija_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench 2026-09-01T00:16:46,485 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,486 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,488 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,490 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,491 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,493 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,494 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,496 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,498 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,500 copying build/lib/lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_sentiment 2026-09-01T00:16:46,502 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,503 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,505 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,507 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,508 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,510 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,512 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,513 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,515 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,517 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,519 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,520 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,522 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,524 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,526 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,527 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,529 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,531 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,532 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,534 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,536 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,537 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,539 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,540 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,542 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,544 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,546 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,547 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,549 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,550 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,552 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,554 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,556 copying build/lib/lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/darija_bench/darija_translation 2026-09-01T00:16:46,558 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,559 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,561 copying build/lib/lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,563 copying build/lib/lm_eval/tasks/humaneval_infilling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,565 copying build/lib/lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,566 copying build/lib/lm_eval/tasks/humaneval_infilling/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,568 copying build/lib/lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,569 copying build/lib/lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/humaneval_infilling 2026-09-01T00:16:46,572 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unitxt 2026-09-01T00:16:46,573 copying build/lib/lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,575 copying build/lib/lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,577 copying build/lib/lm_eval/tasks/unitxt/xsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,578 copying build/lib/lm_eval/tasks/unitxt/atis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,580 copying build/lib/lm_eval/tasks/unitxt/argument_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,582 copying build/lib/lm_eval/tasks/unitxt/stsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,584 copying build/lib/lm_eval/tasks/unitxt/unfair_tos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,587 copying build/lib/lm_eval/tasks/unitxt/ledgar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,589 copying build/lib/lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,591 copying build/lib/lm_eval/tasks/unitxt/ag_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,593 copying build/lib/lm_eval/tasks/unitxt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,595 copying build/lib/lm_eval/tasks/unitxt/doc_vqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,597 copying build/lib/lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,599 copying build/lib/lm_eval/tasks/unitxt/unitxt_multimodal -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,601 copying build/lib/lm_eval/tasks/unitxt/financial_tweets.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,603 copying build/lib/lm_eval/tasks/unitxt/coedit_gec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,605 copying build/lib/lm_eval/tasks/unitxt/banking77.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,607 copying build/lib/lm_eval/tasks/unitxt/unitxt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,610 copying build/lib/lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,612 copying build/lib/lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,614 copying build/lib/lm_eval/tasks/unitxt/ethos_binary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,616 copying build/lib/lm_eval/tasks/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,618 copying build/lib/lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2026-09-01T00:16:46,621 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu 2026-09-01T00:16:46,623 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,624 copying build/lib/lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,626 copying build/lib/lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,628 copying build/lib/lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,630 copying build/lib/lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,632 copying build/lib/lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,634 copying build/lib/lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,636 copying build/lib/lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,638 copying build/lib/lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,640 copying build/lib/lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,642 copying build/lib/lm_eval/tasks/turkishmmlu/config/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2026-09-01T00:16:46,645 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,646 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,649 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,651 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,654 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,657 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,659 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,662 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,665 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,667 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,670 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2026-09-01T00:16:46,672 copying build/lib/lm_eval/tasks/turkishmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu 2026-09-01T00:16:46,676 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3 2026-09-01T00:16:46,677 copying build/lib/lm_eval/tasks/llama3/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3 2026-09-01T00:16:46,680 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct 2026-09-01T00:16:46,681 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:16:46,683 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:16:46,684 copying build/lib/lm_eval/tasks/llama3/instruct/arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/arc_challenge 2026-09-01T00:16:46,687 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,688 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,690 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,692 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,694 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,696 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,697 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,699 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,701 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,703 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,705 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,707 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,708 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,710 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,712 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,714 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,716 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,718 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,720 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,721 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,724 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,726 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,727 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,729 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,731 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,732 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,734 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,736 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,738 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,739 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,741 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,745 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,746 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,749 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,751 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,753 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,755 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,756 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,758 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,760 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,762 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,764 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,766 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,768 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,770 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,771 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,773 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,775 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,777 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,779 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,780 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,782 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,784 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,786 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,788 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,790 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,792 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,793 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,795 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,797 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,799 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,801 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,802 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,804 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_de 2026-09-01T00:16:46,808 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,808 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,811 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,813 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,814 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,816 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,819 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,821 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,823 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,825 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,828 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,830 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,832 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,833 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,836 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,838 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,841 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,843 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,845 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,847 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,850 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,852 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,854 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,857 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,859 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,861 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,863 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,865 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,867 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,870 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,872 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,874 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,876 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,879 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,881 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,883 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,886 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,888 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,889 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,892 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,894 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,896 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,898 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,901 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,903 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,906 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,908 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,910 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,913 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,915 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,917 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,919 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,921 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,923 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,926 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,928 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,930 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,932 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,934 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,936 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,938 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,940 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,942 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,944 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,946 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_hi 2026-09-01T00:16:46,950 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,951 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,953 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,955 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,957 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,958 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,960 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,962 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,964 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,965 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,967 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,969 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,971 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,973 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,974 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,976 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,978 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,980 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,982 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,984 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,986 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,988 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,990 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,992 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,994 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,996 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,998 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:46,999 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,001 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,003 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,004 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,006 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,008 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,010 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,012 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,014 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,016 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,018 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,019 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,021 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,023 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,025 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,027 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,029 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,030 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,032 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,034 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,036 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,038 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,040 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,041 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,043 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,045 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,047 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,049 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,050 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,052 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,054 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,056 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,059 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,060 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,062 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,064 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,066 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,068 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_it 2026-09-01T00:16:47,071 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,072 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,075 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,077 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,079 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,082 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,084 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,086 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,088 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,090 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,093 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,095 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,097 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,099 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,101 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,104 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,106 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,108 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,110 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,112 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,115 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,117 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,119 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,121 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,124 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,125 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,128 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,130 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,132 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,134 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,137 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,139 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,142 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,144 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,147 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,149 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,152 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,154 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,156 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,158 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,161 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,163 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,166 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,168 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,170 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,173 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,175 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,178 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,179 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,182 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,184 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,186 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,189 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,191 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,193 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,196 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,198 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,200 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,203 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,205 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,208 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,210 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,213 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,215 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,218 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_th 2026-09-01T00:16:47,222 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,223 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,225 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,227 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,229 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,231 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,233 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,235 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,237 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,239 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,241 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,243 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,246 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,248 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,250 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,252 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,254 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,257 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,259 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,261 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,263 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,265 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,267 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,269 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,271 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,273 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,275 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,277 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,279 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,281 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,283 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,285 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,287 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,289 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,291 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,294 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,296 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,298 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,300 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,302 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,304 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,306 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,309 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,311 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,313 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,315 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,317 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,319 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,321 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,323 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,325 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,327 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,330 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,331 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,333 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,335 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,337 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,339 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,341 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,343 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,346 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,347 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,349 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,351 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,353 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_fr 2026-09-01T00:16:47,356 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:16:47,357 copying build/lib/lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/gsm8k 2026-09-01T00:16:47,361 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,362 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,364 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,366 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,368 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,370 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,372 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,374 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,376 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,378 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,380 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,382 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,384 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,386 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,388 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,390 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,392 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,394 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,396 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,398 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,400 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,402 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,404 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,406 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,409 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,411 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,413 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,414 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,417 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,419 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,421 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,423 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,425 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,427 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,429 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,431 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,433 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,435 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,437 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,439 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,441 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,443 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,445 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,447 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,449 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,451 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,453 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,455 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,457 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,459 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,461 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,463 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,465 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,467 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,469 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,471 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,473 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,476 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,478 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,480 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,482 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,484 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,486 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,488 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,490 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_es 2026-09-01T00:16:47,494 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,496 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,498 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,500 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,502 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,504 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,506 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,507 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,509 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,511 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,513 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,515 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,517 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,518 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,520 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,522 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,524 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,525 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,527 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,529 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,531 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,533 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,535 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,537 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,539 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,541 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,543 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,545 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,547 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,549 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,551 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,552 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,554 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,556 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,558 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,560 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,562 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,564 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,566 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,568 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,569 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,571 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,573 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,575 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,577 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,579 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,581 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,583 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,585 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,586 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,589 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,590 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,592 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,594 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,596 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,598 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,600 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,602 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,604 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,606 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,607 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,609 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,611 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,613 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu 2026-09-01T00:16:47,616 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,617 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,620 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,621 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,623 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,625 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,627 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,629 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,631 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,633 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,635 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,637 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,639 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,641 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,642 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,644 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,646 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,648 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,650 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,652 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,654 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,656 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,658 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,660 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,662 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,664 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,666 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,668 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,670 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,672 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,674 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,675 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,677 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,679 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,681 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,683 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,685 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,686 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,688 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,690 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,692 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,693 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,695 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,697 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,699 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,701 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,703 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,705 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,707 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,709 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,711 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,713 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,714 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,716 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,718 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,720 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,722 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,724 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,726 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,728 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,730 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,731 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,733 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,735 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_cot 2026-09-01T00:16:47,738 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,739 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,741 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,743 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,745 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,747 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,749 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,751 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,753 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,755 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,756 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,758 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,760 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,762 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,764 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,766 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,768 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,770 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pro 2026-09-01T00:16:47,773 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,774 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,777 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,779 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,781 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,782 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,785 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,787 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,789 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,791 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,793 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,795 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,797 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,799 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,801 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,804 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,805 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,808 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,810 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,812 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,814 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,816 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,818 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,820 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,822 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,824 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,826 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,829 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,831 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,833 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,835 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,837 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,839 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,842 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,844 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,846 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,848 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,850 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,852 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,854 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,857 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,858 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,861 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,863 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,865 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,867 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,869 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,871 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,873 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,875 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,877 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,879 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,881 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,883 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,885 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,887 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,889 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,891 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,893 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,896 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,898 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,900 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,903 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,905 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,908 copying build/lib/lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/llama3/instruct/mmlu_pt 2026-09-01T00:16:47,910 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mutual 2026-09-01T00:16:47,911 copying build/lib/lm_eval/tasks/mutual/multual_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:16:47,913 copying build/lib/lm_eval/tasks/mutual/mutual.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:16:47,915 copying build/lib/lm_eval/tasks/mutual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:16:47,917 copying build/lib/lm_eval/tasks/mutual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2026-09-01T00:16:47,920 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice 2026-09-01T00:16:47,921 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq 2026-09-01T00:16:47,923 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:16:47,924 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:16:47,926 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:16:47,928 copying build/lib/lm_eval/tasks/aradice/boolq/ENG/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/ENG 2026-09-01T00:16:47,930 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:16:47,932 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:16:47,934 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:16:47,936 copying build/lib/lm_eval/tasks/aradice/boolq/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/EGY 2026-09-01T00:16:47,938 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:16:47,939 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:16:47,942 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:16:47,944 copying build/lib/lm_eval/tasks/aradice/boolq/MSA/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/MSA 2026-09-01T00:16:47,946 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:16:47,947 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:16:47,949 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:16:47,951 copying build/lib/lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/boolq/LEV 2026-09-01T00:16:47,954 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,955 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,957 copying build/lib/lm_eval/tasks/aradice/openbookqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,959 copying build/lib/lm_eval/tasks/aradice/openbookqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,961 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,963 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,964 copying build/lib/lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/openbookqa 2026-09-01T00:16:47,966 copying build/lib/lm_eval/tasks/aradice/aradice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2026-09-01T00:16:47,969 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:47,970 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:47,972 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:47,974 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:47,976 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:47,978 copying build/lib/lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/truthfulqa_mcq 2026-09-01T00:16:47,980 copying build/lib/lm_eval/tasks/aradice/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice 2026-09-01T00:16:47,982 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/piqa 2026-09-01T00:16:47,983 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:16:47,985 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:16:47,987 copying build/lib/lm_eval/tasks/aradice/piqa/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:16:47,989 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:16:47,991 copying build/lib/lm_eval/tasks/aradice/piqa/piqa_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/piqa 2026-09-01T00:16:47,993 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:47,995 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:47,997 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:47,999 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:48,000 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:48,002 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:48,004 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:48,006 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:48,008 copying build/lib/lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/cultural-benchmark 2026-09-01T00:16:48,010 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU 2026-09-01T00:16:48,012 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,013 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,015 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,017 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,018 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,020 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,022 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,024 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,026 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,028 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,030 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,031 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,033 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,035 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,037 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,038 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,040 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,042 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,044 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,046 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,047 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,049 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,051 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,052 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,054 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,056 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,058 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,059 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,061 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,063 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,065 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,067 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,068 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,070 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,072 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,074 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,075 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,077 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,079 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,081 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,082 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,084 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,086 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,088 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,090 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/EGY 2026-09-01T00:16:48,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,093 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,095 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,097 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,099 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,101 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,103 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,105 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,106 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,108 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,110 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,112 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,113 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,115 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,117 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,119 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,120 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,122 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,124 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,125 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,127 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,129 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,131 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,132 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,134 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,136 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,138 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,140 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,141 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,143 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,145 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,147 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,149 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,151 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,152 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,154 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,156 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,158 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,159 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,161 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,163 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,165 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,166 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,168 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,170 copying build/lib/lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/ArabicMMLU/LEV 2026-09-01T00:16:48,172 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,173 copying build/lib/lm_eval/tasks/aradice/winogrande/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,176 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,177 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,179 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,181 copying build/lib/lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,183 copying build/lib/lm_eval/tasks/aradice/winogrande/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aradice/winogrande 2026-09-01T00:16:48,185 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_proficiency 2026-09-01T00:16:48,186 copying build/lib/lm_eval/tasks/eus_proficiency/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2026-09-01T00:16:48,189 copying build/lib/lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2026-09-01T00:16:48,191 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbq 2026-09-01T00:16:48,192 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,194 copying build/lib/lm_eval/tasks/bbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,196 copying build/lib/lm_eval/tasks/bbq/bbq_generate_ambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,198 copying build/lib/lm_eval/tasks/bbq/bbq_generate_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,200 copying build/lib/lm_eval/tasks/bbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,203 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,205 copying build/lib/lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,206 copying build/lib/lm_eval/tasks/bbq/bbq_generate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbq 2026-09-01T00:16:48,209 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tydiqa 2026-09-01T00:16:48,210 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,212 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,214 copying build/lib/lm_eval/tasks/tydiqa/_tydiqa_goldp_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,215 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,217 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,219 copying build/lib/lm_eval/tasks/tydiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,221 copying build/lib/lm_eval/tasks/tydiqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,223 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,225 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,227 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,228 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,230 copying build/lib/lm_eval/tasks/tydiqa/tydiqa_goldp_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tydiqa 2026-09-01T00:16:48,233 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu 2026-09-01T00:16:48,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot 2026-09-01T00:16:48,237 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,239 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,240 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,242 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,244 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,246 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,248 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,250 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,252 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,253 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,255 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,257 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,259 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,261 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,263 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,264 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,266 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,268 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,270 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,272 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,274 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,275 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,277 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,279 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,281 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,283 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,285 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,286 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,288 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,290 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,292 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,294 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,296 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,297 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,299 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,301 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,303 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,304 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,306 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,308 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,310 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,312 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,313 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,315 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,317 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,319 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,321 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,323 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,325 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,326 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,328 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,330 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,332 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,334 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,336 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,337 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,339 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,341 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,343 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,345 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2026-09-01T00:16:48,348 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,349 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,351 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,353 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,354 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,356 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,358 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,360 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,362 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,364 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,366 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,367 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,369 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,371 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,372 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,374 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,376 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,378 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,380 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,382 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,384 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,386 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,388 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,390 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,392 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,393 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,395 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,397 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,399 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,401 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,403 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,405 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,407 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,409 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,411 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,413 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,415 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,418 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,420 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,421 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,423 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,425 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,427 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,429 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,431 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,432 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,434 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,436 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,438 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,440 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,442 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,444 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,446 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,448 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,450 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,452 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,454 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,456 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,458 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,459 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,461 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2026-09-01T00:16:48,465 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,466 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,468 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,470 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,471 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,473 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,475 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,477 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,479 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,481 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,483 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,485 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,487 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,489 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,490 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,493 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,494 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,496 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,498 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,500 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,502 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,504 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,505 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,507 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,509 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,511 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,513 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,515 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,516 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,518 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,520 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,522 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,524 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,526 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,528 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,530 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,532 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,534 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,536 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,537 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,539 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,541 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,543 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,545 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,547 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,549 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,550 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,552 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,554 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,556 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,558 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,560 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,561 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,563 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,565 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,567 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,569 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,571 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,573 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,575 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,577 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2026-09-01T00:16:48,580 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,581 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,583 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,585 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,587 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,589 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,591 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,593 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,595 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,597 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,599 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,601 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,603 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,605 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,607 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,609 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,611 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,614 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,616 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,618 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,620 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,622 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,624 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,626 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,628 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,630 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,632 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,634 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,636 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,641 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,643 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,646 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,647 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,649 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,651 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,653 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,655 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,657 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,659 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,661 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,663 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,665 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,667 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,669 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,670 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,673 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,675 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,677 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,679 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,681 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,683 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,685 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,687 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,689 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,690 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,692 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,694 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,696 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,699 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,700 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,703 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2026-09-01T00:16:48,705 copying build/lib/lm_eval/tasks/mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2026-09-01T00:16:48,708 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,709 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,710 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,712 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,714 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,716 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,717 copying build/lib/lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,719 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,721 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,722 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,724 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,725 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,727 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,729 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,731 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,732 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,734 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,736 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,737 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,739 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,741 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,742 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,744 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,746 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,748 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,749 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,751 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,753 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,754 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,756 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,758 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,760 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,761 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,763 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,765 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,766 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,768 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,770 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,771 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,773 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,774 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,776 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,778 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,779 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,781 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,783 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,784 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,786 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,788 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,789 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,791 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,793 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,795 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,797 copying build/lib/lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,799 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,801 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,803 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,806 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,808 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,810 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2026-09-01T00:16:48,812 copying build/lib/lm_eval/tasks/mmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2026-09-01T00:16:48,816 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,818 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,820 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,822 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,824 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,827 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,829 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,831 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,833 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,836 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,838 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,840 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,842 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,845 copying build/lib/lm_eval/tasks/mmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,847 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,849 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,852 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,854 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,856 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,859 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,861 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,863 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,865 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,867 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,869 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,871 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,874 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,876 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,878 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,880 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,883 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,885 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,887 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,889 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,892 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,894 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,896 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,898 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,900 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,902 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,903 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,905 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,907 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,909 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,910 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,912 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,914 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,915 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,917 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,919 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,920 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,922 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,924 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,925 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,927 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,929 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,930 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,932 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,934 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,935 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,937 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,939 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,940 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,942 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2026-09-01T00:16:48,945 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,946 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,948 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,950 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,951 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,953 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,955 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,957 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,958 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,960 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,961 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,963 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,965 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,967 copying build/lib/lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,968 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,970 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,971 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,973 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,975 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,977 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,978 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,980 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,981 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,983 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,985 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,987 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,988 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,990 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,992 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,994 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,995 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,997 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:48,999 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,000 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,002 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,004 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,005 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,007 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,009 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,010 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,012 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,014 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,015 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,017 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,019 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,021 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,022 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,024 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,026 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,027 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,029 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,031 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,033 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,034 copying build/lib/lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,036 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,038 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,040 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,041 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,043 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,044 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2026-09-01T00:16:49,047 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wikitext 2026-09-01T00:16:49,048 copying build/lib/lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-09-01T00:16:49,049 copying build/lib/lm_eval/tasks/wikitext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-09-01T00:16:49,051 copying build/lib/lm_eval/tasks/wikitext/wikitext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2026-09-01T00:16:49,053 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile_10k 2026-09-01T00:16:49,054 copying build/lib/lm_eval/tasks/pile_10k/pile_10k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2026-09-01T00:16:49,056 copying build/lib/lm_eval/tasks/pile_10k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2026-09-01T00:16:49,059 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medqa 2026-09-01T00:16:49,060 copying build/lib/lm_eval/tasks/medqa/medqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2026-09-01T00:16:49,062 copying build/lib/lm_eval/tasks/medqa/preprocess_medqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2026-09-01T00:16:49,064 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medtext 2026-09-01T00:16:49,065 copying build/lib/lm_eval/tasks/medtext/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:16:49,067 copying build/lib/lm_eval/tasks/medtext/medtext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:16:49,069 copying build/lib/lm_eval/tasks/medtext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:16:49,071 copying build/lib/lm_eval/tasks/medtext/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:16:49,073 copying build/lib/lm_eval/tasks/medtext/medtext_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medtext 2026-09-01T00:16:49,075 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noticia 2026-09-01T00:16:49,076 copying build/lib/lm_eval/tasks/noticia/noticia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-09-01T00:16:49,078 copying build/lib/lm_eval/tasks/noticia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-09-01T00:16:49,080 copying build/lib/lm_eval/tasks/noticia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2026-09-01T00:16:49,082 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/olaph 2026-09-01T00:16:49,083 copying build/lib/lm_eval/tasks/olaph/utils_perplexity.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:16:49,085 copying build/lib/lm_eval/tasks/olaph/olaph_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:16:49,087 copying build/lib/lm_eval/tasks/olaph/olaph.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:16:49,089 copying build/lib/lm_eval/tasks/olaph/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:16:49,091 copying build/lib/lm_eval/tasks/olaph/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/olaph 2026-09-01T00:16:49,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/race 2026-09-01T00:16:49,094 copying build/lib/lm_eval/tasks/race/race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-09-01T00:16:49,096 copying build/lib/lm_eval/tasks/race/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-09-01T00:16:49,098 copying build/lib/lm_eval/tasks/race/preprocess_race.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2026-09-01T00:16:49,100 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/metabench 2026-09-01T00:16:49,101 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,103 copying build/lib/lm_eval/tasks/metabench/metabench_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,104 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,106 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,108 copying build/lib/lm_eval/tasks/metabench/metabench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,109 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,111 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,113 copying build/lib/lm_eval/tasks/metabench/metabench_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,114 copying build/lib/lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,117 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,118 copying build/lib/lm_eval/tasks/metabench/process_docs_permute.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,120 copying build/lib/lm_eval/tasks/metabench/metabench_arc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,122 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,124 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,126 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,127 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,129 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,131 copying build/lib/lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,133 copying build/lib/lm_eval/tasks/metabench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,135 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,137 copying build/lib/lm_eval/tasks/metabench/process_docs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,139 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,141 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,143 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,144 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,146 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,148 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,149 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,151 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2026-09-01T00:16:49,153 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xwinograd 2026-09-01T00:16:49,154 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,156 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,157 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,159 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,161 copying build/lib/lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,162 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,164 copying build/lib/lm_eval/tasks/xwinograd/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,166 copying build/lib/lm_eval/tasks/xwinograd/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,168 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,169 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2026-09-01T00:16:49,172 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,173 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,174 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,176 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,178 copying build/lib/lm_eval/tasks/lambada_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,180 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,181 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2026-09-01T00:16:49,183 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/anli 2026-09-01T00:16:49,184 copying build/lib/lm_eval/tasks/anli/anli_r1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:16:49,186 copying build/lib/lm_eval/tasks/anli/anli_r2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:16:49,188 copying build/lib/lm_eval/tasks/anli/anli_r3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:16:49,189 copying build/lib/lm_eval/tasks/anli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2026-09-01T00:16:49,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,193 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,195 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,196 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,198 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,200 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,201 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,203 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,205 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,206 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,208 copying build/lib/lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,209 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,211 copying build/lib/lm_eval/tasks/arab_culture_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,213 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,215 copying build/lib/lm_eval/tasks/arab_culture_completion/prompts.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,217 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,219 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,220 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,222 copying build/lib/lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,224 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,226 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,228 copying build/lib/lm_eval/tasks/arab_culture_completion/utils_completion.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,229 copying build/lib/lm_eval/tasks/arab_culture_completion/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,231 copying build/lib/lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arab_culture_completion 2026-09-01T00:16:49,233 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paloma 2026-09-01T00:16:49,234 copying build/lib/lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,236 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,238 copying build/lib/lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,239 copying build/lib/lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,241 copying build/lib/lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,243 copying build/lib/lm_eval/tasks/paloma/paloma_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,244 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,246 copying build/lib/lm_eval/tasks/paloma/paloma_mc4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,247 copying build/lib/lm_eval/tasks/paloma/_paloma_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,249 copying build/lib/lm_eval/tasks/paloma/paloma_ptb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,251 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,252 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,254 copying build/lib/lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,256 copying build/lib/lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,257 copying build/lib/lm_eval/tasks/paloma/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,259 copying build/lib/lm_eval/tasks/paloma/paloma_gab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,261 copying build/lib/lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,263 copying build/lib/lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,264 copying build/lib/lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2026-09-01T00:16:49,267 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/graphwalks 2026-09-01T00:16:49,268 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_128k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:16:49,270 copying build/lib/lm_eval/tasks/graphwalks/graphwalks_1M.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:16:49,271 copying build/lib/lm_eval/tasks/graphwalks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:16:49,273 copying build/lib/lm_eval/tasks/graphwalks/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:16:49,275 copying build/lib/lm_eval/tasks/graphwalks/graphwalks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/graphwalks 2026-09-01T00:16:49,278 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/prost 2026-09-01T00:16:49,278 copying build/lib/lm_eval/tasks/prost/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2026-09-01T00:16:49,280 copying build/lib/lm_eval/tasks/prost/corypaik_prost.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2026-09-01T00:16:49,283 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/moral_stories 2026-09-01T00:16:49,283 copying build/lib/lm_eval/tasks/moral_stories/moral_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-09-01T00:16:49,285 copying build/lib/lm_eval/tasks/moral_stories/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-09-01T00:16:49,288 copying build/lib/lm_eval/tasks/moral_stories/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/moral_stories 2026-09-01T00:16:49,290 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/sciq 2026-09-01T00:16:49,291 copying build/lib/lm_eval/tasks/sciq/sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2026-09-01T00:16:49,293 copying build/lib/lm_eval/tasks/sciq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2026-09-01T00:16:49,295 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swag 2026-09-01T00:16:49,296 copying build/lib/lm_eval/tasks/swag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2026-09-01T00:16:49,298 copying build/lib/lm_eval/tasks/swag/swag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2026-09-01T00:16:49,300 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,301 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom_variations_org.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,303 copying build/lib/lm_eval/tasks/putnam_axiom/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,305 copying build/lib/lm_eval/tasks/putnam_axiom/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,307 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom_original.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,309 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom_variations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,311 copying build/lib/lm_eval/tasks/putnam_axiom/putnam_axiom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/putnam_axiom 2026-09-01T00:16:49,313 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc 2026-09-01T00:16:49,314 copying build/lib/lm_eval/tasks/arc/arc_challenge_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:16:49,316 copying build/lib/lm_eval/tasks/arc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:16:49,318 copying build/lib/lm_eval/tasks/arc/arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:16:49,320 copying build/lib/lm_eval/tasks/arc/arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2026-09-01T00:16:49,322 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/common_voice 2026-09-01T00:16:49,323 copying build/lib/lm_eval/tasks/common_voice/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2026-09-01T00:16:49,325 copying build/lib/lm_eval/tasks/common_voice/common_voice_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/common_voice 2026-09-01T00:16:49,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue 2026-09-01T00:16:49,329 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qqp 2026-09-01T00:16:49,330 copying build/lib/lm_eval/tasks/glue/qqp/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qqp 2026-09-01T00:16:49,333 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mnli 2026-09-01T00:16:49,334 copying build/lib/lm_eval/tasks/glue/mnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-09-01T00:16:49,335 copying build/lib/lm_eval/tasks/glue/mnli/mismatch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-09-01T00:16:49,337 copying build/lib/lm_eval/tasks/glue/mnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2026-09-01T00:16:49,339 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/wnli 2026-09-01T00:16:49,340 copying build/lib/lm_eval/tasks/glue/wnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/wnli 2026-09-01T00:16:49,343 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/rte 2026-09-01T00:16:49,344 copying build/lib/lm_eval/tasks/glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/rte 2026-09-01T00:16:49,346 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qnli 2026-09-01T00:16:49,347 copying build/lib/lm_eval/tasks/glue/qnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qnli 2026-09-01T00:16:49,349 copying build/lib/lm_eval/tasks/glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue 2026-09-01T00:16:49,351 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/sst2 2026-09-01T00:16:49,352 copying build/lib/lm_eval/tasks/glue/sst2/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/sst2 2026-09-01T00:16:49,354 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mrpc 2026-09-01T00:16:49,355 copying build/lib/lm_eval/tasks/glue/mrpc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mrpc 2026-09-01T00:16:49,357 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/cola 2026-09-01T00:16:49,358 copying build/lib/lm_eval/tasks/glue/cola/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/cola 2026-09-01T00:16:49,361 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qasper 2026-09-01T00:16:49,362 copying build/lib/lm_eval/tasks/qasper/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:16:49,364 copying build/lib/lm_eval/tasks/qasper/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:16:49,366 copying build/lib/lm_eval/tasks/qasper/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:16:49,368 copying build/lib/lm_eval/tasks/qasper/freeform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:16:49,369 copying build/lib/lm_eval/tasks/qasper/bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2026-09-01T00:16:49,372 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hellaswag 2026-09-01T00:16:49,373 copying build/lib/lm_eval/tasks/hellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-09-01T00:16:49,375 copying build/lib/lm_eval/tasks/hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-09-01T00:16:49,376 copying build/lib/lm_eval/tasks/hellaswag/hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2026-09-01T00:16:49,379 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/esbbq 2026-09-01T00:16:49,379 copying build/lib/lm_eval/tasks/esbbq/_esbbq_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,381 copying build/lib/lm_eval/tasks/esbbq/esbbq_ses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,383 copying build/lib/lm_eval/tasks/esbbq/esbbq_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,385 copying build/lib/lm_eval/tasks/esbbq/esbbq_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,387 copying build/lib/lm_eval/tasks/esbbq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,389 copying build/lib/lm_eval/tasks/esbbq/esbbq_disability_status.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,390 copying build/lib/lm_eval/tasks/esbbq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,393 copying build/lib/lm_eval/tasks/esbbq/esbbq_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,394 copying build/lib/lm_eval/tasks/esbbq/esbbq_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,396 copying build/lib/lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,397 copying build/lib/lm_eval/tasks/esbbq/esbbq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,399 copying build/lib/lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,401 copying build/lib/lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,402 copying build/lib/lm_eval/tasks/esbbq/esbbq_spanish_region.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/esbbq 2026-09-01T00:16:49,405 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/jfinqa 2026-09-01T00:16:49,406 copying build/lib/lm_eval/tasks/jfinqa/jfinqa_temporal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,407 copying build/lib/lm_eval/tasks/jfinqa/jfinqa_numerical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,409 copying build/lib/lm_eval/tasks/jfinqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,411 copying build/lib/lm_eval/tasks/jfinqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,413 copying build/lib/lm_eval/tasks/jfinqa/test_jfinqa_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,415 copying build/lib/lm_eval/tasks/jfinqa/jfinqa_consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,417 copying build/lib/lm_eval/tasks/jfinqa/_jfinqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/jfinqa 2026-09-01T00:16:49,419 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench 2026-09-01T00:16:49,423 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,424 copying build/lib/lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,426 copying build/lib/lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,428 copying build/lib/lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,429 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,431 copying build/lib/lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,433 copying build/lib/lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,435 copying build/lib/lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,436 copying build/lib/lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,438 copying build/lib/lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,440 copying build/lib/lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,442 copying build/lib/lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,443 copying build/lib/lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,445 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,447 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,448 copying build/lib/lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,450 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,451 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,453 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,455 copying build/lib/lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,456 copying build/lib/lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,458 copying build/lib/lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,460 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,461 copying build/lib/lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,463 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,465 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,467 copying build/lib/lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,468 copying build/lib/lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,470 copying build/lib/lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,472 copying build/lib/lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,473 copying build/lib/lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,475 copying build/lib/lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,477 copying build/lib/lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,479 copying build/lib/lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,480 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,482 copying build/lib/lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,483 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,485 copying build/lib/lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,487 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,488 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,490 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,492 copying build/lib/lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,493 copying build/lib/lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,495 copying build/lib/lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,497 copying build/lib/lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,498 copying build/lib/lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,500 copying build/lib/lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,502 copying build/lib/lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,504 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,505 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,507 copying build/lib/lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,509 copying build/lib/lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,510 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,512 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,514 copying build/lib/lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,516 copying build/lib/lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,517 copying build/lib/lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,519 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,520 copying build/lib/lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,522 copying build/lib/lm_eval/tasks/bigbench/generate_until/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,524 copying build/lib/lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,525 copying build/lib/lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,527 copying build/lib/lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,528 copying build/lib/lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,530 copying build/lib/lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,532 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,534 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,535 copying build/lib/lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,537 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,539 copying build/lib/lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,540 copying build/lib/lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,542 copying build/lib/lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,544 copying build/lib/lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,546 copying build/lib/lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,547 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,549 copying build/lib/lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,551 copying build/lib/lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,553 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,554 copying build/lib/lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,556 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,558 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,559 copying build/lib/lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,561 copying build/lib/lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,563 copying build/lib/lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,565 copying build/lib/lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,566 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,568 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,570 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,572 copying build/lib/lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,574 copying build/lib/lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,576 copying build/lib/lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,578 copying build/lib/lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,579 copying build/lib/lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,581 copying build/lib/lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,583 copying build/lib/lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,585 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,587 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,589 copying build/lib/lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,590 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,592 copying build/lib/lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,594 copying build/lib/lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,596 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,598 copying build/lib/lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,600 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,601 copying build/lib/lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,603 copying build/lib/lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,605 copying build/lib/lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,607 copying build/lib/lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,609 copying build/lib/lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,611 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,612 copying build/lib/lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,614 copying build/lib/lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,616 copying build/lib/lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,618 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,620 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,622 copying build/lib/lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,624 copying build/lib/lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,626 copying build/lib/lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,628 copying build/lib/lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,630 copying build/lib/lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,631 copying build/lib/lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,633 copying build/lib/lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,635 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,637 copying build/lib/lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,639 copying build/lib/lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,641 copying build/lib/lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,643 copying build/lib/lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,644 copying build/lib/lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,646 copying build/lib/lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,648 copying build/lib/lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,649 copying build/lib/lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,651 copying build/lib/lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,653 copying build/lib/lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,655 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,657 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,659 copying build/lib/lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,660 copying build/lib/lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,662 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,664 copying build/lib/lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,666 copying build/lib/lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,668 copying build/lib/lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,669 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,671 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,673 copying build/lib/lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,675 copying build/lib/lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,677 copying build/lib/lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,678 copying build/lib/lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,680 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,682 copying build/lib/lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,684 copying build/lib/lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,686 copying build/lib/lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,688 copying build/lib/lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,689 copying build/lib/lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,691 copying build/lib/lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,693 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,695 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,697 copying build/lib/lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,698 copying build/lib/lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,700 copying build/lib/lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,702 copying build/lib/lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,704 copying build/lib/lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,706 copying build/lib/lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,708 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,710 copying build/lib/lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,712 copying build/lib/lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,713 copying build/lib/lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,715 copying build/lib/lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,717 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2026-09-01T00:16:49,719 copying build/lib/lm_eval/tasks/bigbench/generate_until_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,721 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,723 copying build/lib/lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,725 copying build/lib/lm_eval/tasks/bigbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,727 copying build/lib/lm_eval/tasks/bigbench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,729 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,733 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,734 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,737 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,739 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,740 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,742 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,744 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,746 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,748 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,749 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,751 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,753 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,755 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,757 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,759 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,761 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,762 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,764 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,766 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,768 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,770 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,772 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,773 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,775 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,777 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,779 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,780 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,782 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,784 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,786 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,788 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,790 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,791 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,793 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,795 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,797 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,799 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,801 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,802 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,804 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,806 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,808 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,810 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,812 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,813 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,815 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,817 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,819 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,820 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,822 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,824 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,826 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,828 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,829 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,831 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,833 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,835 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,837 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,839 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,841 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,843 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,845 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,847 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,849 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,851 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,852 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,854 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,856 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,858 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,859 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,861 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,863 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,864 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,866 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,868 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,870 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,872 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,874 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,876 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,878 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,880 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,881 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,883 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,885 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,887 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,889 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,891 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,893 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,895 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,896 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,898 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,900 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,902 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,903 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,905 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,907 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,909 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,910 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,913 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,914 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,916 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,918 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,920 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,922 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,924 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,925 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,927 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,929 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,931 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,933 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,935 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,937 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,939 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,940 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,942 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,944 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,945 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,947 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,949 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,950 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2026-09-01T00:16:49,952 copying build/lib/lm_eval/tasks/bigbench/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2026-09-01T00:16:49,955 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc 2026-09-01T00:16:49,956 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,958 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,959 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,961 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,963 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,965 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,967 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,968 copying build/lib/lm_eval/tasks/e2lmc/noor/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,970 copying build/lib/lm_eval/tasks/e2lmc/noor/_noor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,972 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,974 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,976 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,978 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,980 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,982 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,983 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,985 copying build/lib/lm_eval/tasks/e2lmc/noor/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,987 copying build/lib/lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/noor 2026-09-01T00:16:49,989 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:16:49,990 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:16:49,992 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:16:49,994 copying build/lib/lm_eval/tasks/e2lmc/mmlu_early_training/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/mmlu_early_training 2026-09-01T00:16:49,997 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:49,998 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,000 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,001 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,003 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,005 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,007 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,009 copying build/lib/lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/e2lmc/sciknoweval_mcqa 2026-09-01T00:16:50,012 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli_eu 2026-09-01T00:16:50,013 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:16:50,015 copying build/lib/lm_eval/tasks/xnli_eu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:16:50,017 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:16:50,019 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:16:50,021 copying build/lib/lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2026-09-01T00:16:50,024 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard 2026-09-01T00:16:50,025 copying build/lib/lm_eval/tasks/leaderboard/leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2026-09-01T00:16:50,027 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,028 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,030 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,032 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,034 copying build/lib/lm_eval/tasks/leaderboard/gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,036 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,037 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2026-09-01T00:16:50,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,041 copying build/lib/lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,043 copying build/lib/lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,045 copying build/lib/lm_eval/tasks/leaderboard/math/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,047 copying build/lib/lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,049 copying build/lib/lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,050 copying build/lib/lm_eval/tasks/leaderboard/math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,053 copying build/lib/lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,055 copying build/lib/lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,057 copying build/lib/lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,059 copying build/lib/lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2026-09-01T00:16:50,060 copying build/lib/lm_eval/tasks/leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2026-09-01T00:16:50,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,065 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,067 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,070 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,073 copying build/lib/lm_eval/tasks/leaderboard/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,076 copying build/lib/lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,078 copying build/lib/lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2026-09-01T00:16:50,080 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,081 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,084 copying build/lib/lm_eval/tasks/leaderboard/musr/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,085 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,087 copying build/lib/lm_eval/tasks/leaderboard/musr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,089 copying build/lib/lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,091 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2026-09-01T00:16:50,093 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:16:50,095 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:16:50,097 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2026-09-01T00:16:50,099 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,101 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,103 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,105 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,107 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,109 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,111 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,113 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,115 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,117 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,119 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,121 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,123 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,125 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,127 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,129 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,131 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,133 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,135 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,137 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,139 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,141 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,143 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,145 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,147 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,149 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,150 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2026-09-01T00:16:50,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp 2026-09-01T00:16:50,155 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,157 copying build/lib/lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,159 copying build/lib/lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,161 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,163 copying build/lib/lm_eval/tasks/blimp/intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,165 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,167 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,169 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,171 copying build/lib/lm_eval/tasks/blimp/generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,173 copying build/lib/lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,175 copying build/lib/lm_eval/tasks/blimp/transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,177 copying build/lib/lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,179 copying build/lib/lm_eval/tasks/blimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,181 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,183 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,184 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,187 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,188 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,190 copying build/lib/lm_eval/tasks/blimp/adjunct_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,192 copying build/lib/lm_eval/tasks/blimp/inchoative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,194 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,195 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,197 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,199 copying build/lib/lm_eval/tasks/blimp/_blimp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,201 copying build/lib/lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,203 copying build/lib/lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,204 copying build/lib/lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,206 copying build/lib/lm_eval/tasks/blimp/wh_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,208 copying build/lib/lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,210 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,212 copying build/lib/lm_eval/tasks/blimp/causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,213 copying build/lib/lm_eval/tasks/blimp/npi_present_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,215 copying build/lib/lm_eval/tasks/blimp/npi_present_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,217 copying build/lib/lm_eval/tasks/blimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,219 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,221 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,223 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,225 copying build/lib/lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,227 copying build/lib/lm_eval/tasks/blimp/drop_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,229 copying build/lib/lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,230 copying build/lib/lm_eval/tasks/blimp/passive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,232 copying build/lib/lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,234 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,236 copying build/lib/lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,238 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,240 copying build/lib/lm_eval/tasks/blimp/only_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,242 copying build/lib/lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,243 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,245 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,247 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,249 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,250 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,252 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,254 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,256 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,258 copying build/lib/lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,260 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,261 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,263 copying build/lib/lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,265 copying build/lib/lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,267 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,269 copying build/lib/lm_eval/tasks/blimp/passive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,271 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,273 copying build/lib/lm_eval/tasks/blimp/complex_NP_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,275 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,277 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,278 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,280 copying build/lib/lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,282 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,284 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,286 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2026-09-01T00:16:50,288 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,289 copying build/lib/lm_eval/tasks/nerel-bench/ru_relation_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,291 copying build/lib/lm_eval/tasks/nerel-bench/ru_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,293 copying build/lib/lm_eval/tasks/nerel-bench/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,294 copying build/lib/lm_eval/tasks/nerel-bench/ru_relation_definition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,296 copying build/lib/lm_eval/tasks/nerel-bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,299 copying build/lib/lm_eval/tasks/nerel-bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,302 copying build/lib/lm_eval/tasks/nerel-bench/ru_entity_definition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nerel-bench 2026-09-01T00:16:50,304 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/minerva_math 2026-09-01T00:16:50,305 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,307 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,309 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,311 copying build/lib/lm_eval/tasks/minerva_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,313 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,315 copying build/lib/lm_eval/tasks/minerva_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,318 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,319 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,321 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,323 copying build/lib/lm_eval/tasks/minerva_math/minerva_math500.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2026-09-01T00:16:50,326 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unscramble 2026-09-01T00:16:50,327 copying build/lib/lm_eval/tasks/unscramble/cycle_letters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:16:50,329 copying build/lib/lm_eval/tasks/unscramble/anagrams2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:16:50,331 copying build/lib/lm_eval/tasks/unscramble/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:16:50,333 copying build/lib/lm_eval/tasks/unscramble/reversed_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:16:50,335 copying build/lib/lm_eval/tasks/unscramble/anagrams1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:16:50,337 copying build/lib/lm_eval/tasks/unscramble/random_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2026-09-01T00:16:50,339 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squadv2 2026-09-01T00:16:50,340 copying build/lib/lm_eval/tasks/squadv2/squadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-09-01T00:16:50,342 copying build/lib/lm_eval/tasks/squadv2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-09-01T00:16:50,344 copying build/lib/lm_eval/tasks/squadv2/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2026-09-01T00:16:50,347 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,348 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,350 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,352 copying build/lib/lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,353 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,355 copying build/lib/lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,357 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,359 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,361 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,363 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,364 copying build/lib/lm_eval/tasks/mmlu_pro/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,367 copying build/lib/lm_eval/tasks/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,369 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,370 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,372 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,374 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,376 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,378 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,380 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2026-09-01T00:16:50,384 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/multiblimp 2026-09-01T00:16:50,385 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ell.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,387 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lav.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,389 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,391 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_koi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,393 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_orv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,395 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_abk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,396 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sqi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,398 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ita.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,400 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sah.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,402 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_frm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,403 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hye.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,405 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hyw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,407 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uig.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,409 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,410 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,412 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xpg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,414 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bua.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,416 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xnr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,418 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,419 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,421 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,423 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_dan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,425 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,427 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,428 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_rus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,430 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ukr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,432 copying build/lib/lm_eval/tasks/multiblimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,434 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,436 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,438 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_yrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,440 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_spa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,442 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,444 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,446 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nld.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,447 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_vep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,449 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,451 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,453 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kxh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,454 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,456 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_azz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,458 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_quc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,460 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,462 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gla.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,463 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_lij.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,465 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_gle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,467 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_sms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,469 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_chu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,471 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_xcl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,473 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,474 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tpn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,476 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_por.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,478 copying build/lib/lm_eval/tasks/multiblimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,480 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,482 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aqz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,484 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,486 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_cat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,488 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_nhi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,490 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_krl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,492 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_san.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,494 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,496 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,498 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_myv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,499 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_wbp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,501 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mkd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,503 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_tur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,504 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,506 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,508 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_heb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,510 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_est.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,512 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_grc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,513 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_isl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,515 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_uzb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,517 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,519 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_aln.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,521 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_arb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,522 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,524 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kpv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,526 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_got.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,528 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,530 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_slv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,532 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_fro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,533 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,535 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_olo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,537 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ben.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,539 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kir.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,541 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_pcm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,543 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ttc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,545 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,547 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_guj.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,548 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_kaz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,550 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_deu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,552 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,554 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_urd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,555 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,557 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_bel.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,559 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_swe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,561 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ces.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,562 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_mdf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,564 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_hbo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,566 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_apu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,568 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_glg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,570 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_egy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,572 copying build/lib/lm_eval/tasks/multiblimp/multiblimp_ota.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/multiblimp 2026-09-01T00:16:50,574 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medmcqa 2026-09-01T00:16:50,575 copying build/lib/lm_eval/tasks/medmcqa/medmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2026-09-01T00:16:50,577 copying build/lib/lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2026-09-01T00:16:50,580 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/polemo2 2026-09-01T00:16:50,581 copying build/lib/lm_eval/tasks/polemo2/polemo2_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-09-01T00:16:50,583 copying build/lib/lm_eval/tasks/polemo2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-09-01T00:16:50,585 copying build/lib/lm_eval/tasks/polemo2/polemo2_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2026-09-01T00:16:50,588 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl 2026-09-01T00:16:50,590 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:50,591 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:50,593 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:50,595 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:50,597 copying build/lib/lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:50,599 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2026-09-01T00:16:50,601 copying build/lib/lm_eval/tasks/kbl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl 2026-09-01T00:16:50,604 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam 2026-09-01T00:16:50,606 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,607 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,609 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,611 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,613 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,615 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,617 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,619 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,621 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,623 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,624 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,626 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,628 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,630 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,632 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2026-09-01T00:16:50,635 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,636 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,638 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,640 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,642 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,644 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,646 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,648 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,650 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,651 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,653 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,655 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,657 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,659 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,660 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,662 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2026-09-01T00:16:50,665 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,666 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,668 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,670 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,671 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,673 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,675 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,677 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,679 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,681 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,683 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,685 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,687 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,689 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,690 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,692 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2026-09-01T00:16:50,695 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,696 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,698 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,699 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,701 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,703 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,705 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,707 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,709 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,711 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,712 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,714 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,716 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,718 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,720 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2026-09-01T00:16:50,722 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,723 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,725 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,727 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,729 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,731 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,732 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,734 copying build/lib/lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,736 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2026-09-01T00:16:50,739 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/libra 2026-09-01T00:16:50,740 copying build/lib/lm_eval/tasks/libra/ru_gsm100.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,742 copying build/lib/lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,744 copying build/lib/lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,746 copying build/lib/lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,747 copying build/lib/lm_eval/tasks/libra/passkey_with_librusec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,749 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,751 copying build/lib/lm_eval/tasks/libra/_multi_hop_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,753 copying build/lib/lm_eval/tasks/libra/ru_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,755 copying build/lib/lm_eval/tasks/libra/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,757 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,759 copying build/lib/lm_eval/tasks/libra/ru_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,761 copying build/lib/lm_eval/tasks/libra/_simple_information_retrieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,763 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,765 copying build/lib/lm_eval/tasks/libra/librusec_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,767 copying build/lib/lm_eval/tasks/libra/ru_2wikimultihopqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,769 copying build/lib/lm_eval/tasks/libra/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,771 copying build/lib/lm_eval/tasks/libra/matreshka_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,773 copying build/lib/lm_eval/tasks/libra/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,775 copying build/lib/lm_eval/tasks/libra/ru_sci_passage_count.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,777 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,779 copying build/lib/lm_eval/tasks/libra/long_context_multiq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,780 copying build/lib/lm_eval/tasks/libra/passkey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,782 copying build/lib/lm_eval/tasks/libra/librusec_mhqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,784 copying build/lib/lm_eval/tasks/libra/ru_babilong_qa4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,786 copying build/lib/lm_eval/tasks/libra/matreshka_yes_no.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/libra 2026-09-01T00:16:50,788 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogrande 2026-09-01T00:16:50,789 copying build/lib/lm_eval/tasks/winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-09-01T00:16:50,791 copying build/lib/lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-09-01T00:16:50,793 copying build/lib/lm_eval/tasks/winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2026-09-01T00:16:50,795 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mc_taco 2026-09-01T00:16:50,796 copying build/lib/lm_eval/tasks/mc_taco/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2026-09-01T00:16:50,798 copying build/lib/lm_eval/tasks/mc_taco/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2026-09-01T00:16:50,801 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arithmetic 2026-09-01T00:16:50,802 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,804 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,806 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,808 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,809 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,811 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,813 copying build/lib/lm_eval/tasks/arithmetic/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,815 copying build/lib/lm_eval/tasks/arithmetic/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,817 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,819 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,820 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,822 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2026-09-01T00:16:50,824 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bangla 2026-09-01T00:16:50,825 copying build/lib/lm_eval/tasks/bangla/bangla_openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:16:50,827 copying build/lib/lm_eval/tasks/bangla/bangla_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:16:50,829 copying build/lib/lm_eval/tasks/bangla/bangla_commonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:16:50,831 copying build/lib/lm_eval/tasks/bangla/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:16:50,832 copying build/lib/lm_eval/tasks/bangla/bangla_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:16:50,834 copying build/lib/lm_eval/tasks/bangla/bangla_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bangla 2026-09-01T00:16:50,839 copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:50,842 copying build/lib/lm_eval/result_schema.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:50,844 copying build/lib/lm_eval/__main__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:50,846 copying build/lib/lm_eval/defaults.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2026-09-01T00:16:50,848 creating build/bdist.linux-armv7l/wheel/lm_eval/_cli 2026-09-01T00:16:50,849 copying build/lib/lm_eval/_cli/ls.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,851 copying build/lib/lm_eval/_cli/harness.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,853 copying build/lib/lm_eval/_cli/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,854 copying build/lib/lm_eval/_cli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,857 copying build/lib/lm_eval/_cli/validate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,859 copying build/lib/lm_eval/_cli/subcommand.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,860 copying build/lib/lm_eval/_cli/run.py -> build/bdist.linux-armv7l/wheel/./lm_eval/_cli 2026-09-01T00:16:50,863 creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination 2026-09-01T00:16:50,864 copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:16:50,867 copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:16:50,869 copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:16:50,871 copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2026-09-01T00:16:50,874 creating build/bdist.linux-armv7l/wheel/lm_eval/api 2026-09-01T00:16:50,875 copying build/lib/lm_eval/api/model.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,877 copying build/lib/lm_eval/api/instance.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,879 copying build/lib/lm_eval/api/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,882 copying build/lib/lm_eval/api/filter.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,884 copying build/lib/lm_eval/api/registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,886 copying build/lib/lm_eval/api/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,888 copying build/lib/lm_eval/api/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,891 copying build/lib/lm_eval/api/samplers.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,893 copying build/lib/lm_eval/api/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,896 copying build/lib/lm_eval/api/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2026-09-01T00:16:50,904 running install_egg_info 2026-09-01T00:16:50,910 Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/./lm_eval-0.4.13.dev0-py3.11.egg-info 2026-09-01T00:16:50,945 running install_scripts 2026-09-01T00:16:50,957 creating build/bdist.linux-armv7l/wheel/lm_eval-0.4.13.dev0.dist-info/WHEEL 2026-09-01T00:16:50,960 creating '/tmp/pip-wheel-21juk1cj/.tmp-v_ekm3no/lm_eval-0.4.13.dev0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-09-01T00:16:50,963 adding 'lm_eval/__init__.py' 2026-09-01T00:16:50,964 adding 'lm_eval/__main__.py' 2026-09-01T00:16:50,965 adding 'lm_eval/defaults.py' 2026-09-01T00:16:50,969 adding 'lm_eval/evaluator.py' 2026-09-01T00:16:50,972 adding 'lm_eval/evaluator_utils.py' 2026-09-01T00:16:50,974 adding 'lm_eval/result_schema.py' 2026-09-01T00:16:50,978 adding 'lm_eval/utils.py' 2026-09-01T00:16:50,980 adding 'lm_eval/_cli/__init__.py' 2026-09-01T00:16:50,982 adding 'lm_eval/_cli/harness.py' 2026-09-01T00:16:50,983 adding 'lm_eval/_cli/ls.py' 2026-09-01T00:16:50,985 adding 'lm_eval/_cli/run.py' 2026-09-01T00:16:50,987 adding 'lm_eval/_cli/subcommand.py' 2026-09-01T00:16:50,988 adding 'lm_eval/_cli/utils.py' 2026-09-01T00:16:50,990 adding 'lm_eval/_cli/validate.py' 2026-09-01T00:16:50,991 adding 'lm_eval/api/__init__.py' 2026-09-01T00:16:50,993 adding 'lm_eval/api/filter.py' 2026-09-01T00:16:50,995 adding 'lm_eval/api/group.py' 2026-09-01T00:16:50,996 adding 'lm_eval/api/instance.py' 2026-09-01T00:16:50,999 adding 'lm_eval/api/metrics.py' 2026-09-01T00:16:51,002 adding 'lm_eval/api/model.py' 2026-09-01T00:16:51,005 adding 'lm_eval/api/registry.py' 2026-09-01T00:16:51,006 adding 'lm_eval/api/samplers.py' 2026-09-01T00:16:51,014 adding 'lm_eval/api/task.py' 2026-09-01T00:16:51,017 adding 'lm_eval/api/utils.py' 2026-09-01T00:16:51,019 adding 'lm_eval/caching/__init__.py' 2026-09-01T00:16:51,021 adding 'lm_eval/caching/cache.py' 2026-09-01T00:16:51,023 adding 'lm_eval/config/__init__.py' 2026-09-01T00:16:51,026 adding 'lm_eval/config/evaluate_config.py' 2026-09-01T00:16:51,028 adding 'lm_eval/config/group.py' 2026-09-01T00:16:51,031 adding 'lm_eval/config/task.py' 2026-09-01T00:16:51,033 adding 'lm_eval/decontamination/__init__.py' 2026-09-01T00:16:51,035 adding 'lm_eval/decontamination/archiver.py' 2026-09-01T00:16:51,037 adding 'lm_eval/decontamination/decontaminate.py' 2026-09-01T00:16:51,040 adding 'lm_eval/decontamination/janitor.py' 2026-09-01T00:16:51,043 adding 'lm_eval/filters/__init__.py' 2026-09-01T00:16:51,044 adding 'lm_eval/filters/custom.py' 2026-09-01T00:16:51,046 adding 'lm_eval/filters/decontamination.py' 2026-09-01T00:16:51,048 adding 'lm_eval/filters/extraction.py' 2026-09-01T00:16:51,050 adding 'lm_eval/filters/selection.py' 2026-09-01T00:16:51,051 adding 'lm_eval/filters/transformation.py' 2026-09-01T00:16:51,054 adding 'lm_eval/loggers/__init__.py' 2026-09-01T00:16:51,058 adding 'lm_eval/loggers/evaluation_tracker.py' 2026-09-01T00:16:51,060 adding 'lm_eval/loggers/trackio_logger.py' 2026-09-01T00:16:51,062 adding 'lm_eval/loggers/utils.py' 2026-09-01T00:16:51,065 adding 'lm_eval/loggers/wandb_logger.py' 2026-09-01T00:16:51,068 adding 'lm_eval/models/__init__.py' 2026-09-01T00:16:51,071 adding 'lm_eval/models/_onnx_base.py' 2026-09-01T00:16:51,074 adding 'lm_eval/models/anthropic_llms.py' 2026-09-01T00:16:51,079 adding 'lm_eval/models/api_models.py' 2026-09-01T00:16:51,082 adding 'lm_eval/models/dummy.py' 2026-09-01T00:16:51,084 adding 'lm_eval/models/gguf.py' 2026-09-01T00:16:51,087 adding 'lm_eval/models/hf_audiolm.py' 2026-09-01T00:16:51,089 adding 'lm_eval/models/hf_steered.py' 2026-09-01T00:16:51,095 adding 'lm_eval/models/hf_vlms.py' 2026-09-01T00:16:51,108 adding 'lm_eval/models/huggingface.py' 2026-09-01T00:16:51,112 adding 'lm_eval/models/ibm_watsonx_ai.py' 2026-09-01T00:16:51,114 adding 'lm_eval/models/litellm_llms.py' 2026-09-01T00:16:51,116 adding 'lm_eval/models/mamba_lm.py' 2026-09-01T00:16:51,122 adding 'lm_eval/models/megatron_lm.py' 2026-09-01T00:16:51,124 adding 'lm_eval/models/mistral3.py' 2026-09-01T00:16:51,127 adding 'lm_eval/models/nemo_lm.py' 2026-09-01T00:16:51,130 adding 'lm_eval/models/neuron_optimum.py' 2026-09-01T00:16:51,132 adding 'lm_eval/models/onnxruntime_genai.py' 2026-09-01T00:16:51,134 adding 'lm_eval/models/onnxruntime_ort.py' 2026-09-01T00:16:51,136 adding 'lm_eval/models/openai_completions.py' 2026-09-01T00:16:51,138 adding 'lm_eval/models/optimum_habana.py' 2026-09-01T00:16:51,139 adding 'lm_eval/models/optimum_ipex.py' 2026-09-01T00:16:51,141 adding 'lm_eval/models/optimum_lm.py' 2026-09-01T00:16:51,143 adding 'lm_eval/models/sglang_causallms.py' 2026-09-01T00:16:51,145 adding 'lm_eval/models/sglang_generate_API.py' 2026-09-01T00:16:51,147 adding 'lm_eval/models/textsynth.py' 2026-09-01T00:16:51,150 adding 'lm_eval/models/trtllm_causallms.py' 2026-09-01T00:16:51,155 adding 'lm_eval/models/utils.py' 2026-09-01T00:16:51,157 adding 'lm_eval/models/utils_hf.py' 2026-09-01T00:16:51,161 adding 'lm_eval/models/vllm_causallms.py' 2026-09-01T00:16:51,163 adding 'lm_eval/models/vllm_vlms.py' 2026-09-01T00:16:51,165 adding 'lm_eval/models/winml.py' 2026-09-01T00:16:51,167 adding 'lm_eval/prompts/__init__.py' 2026-09-01T00:16:51,178 adding 'lm_eval/tasks/README.md' 2026-09-01T00:16:51,181 adding 'lm_eval/tasks/__init__.py' 2026-09-01T00:16:51,183 adding 'lm_eval/tasks/_factory.py' 2026-09-01T00:16:51,184 adding 'lm_eval/tasks/_index.py' 2026-09-01T00:16:51,186 adding 'lm_eval/tasks/_yaml_loader.py' 2026-09-01T00:16:51,188 adding 'lm_eval/tasks/manager.py' 2026-09-01T00:16:51,190 adding 'lm_eval/tasks/aclue/README.md' 2026-09-01T00:16:51,191 adding 'lm_eval/tasks/aclue/_aclue.yaml' 2026-09-01T00:16:51,193 adding 'lm_eval/tasks/aclue/_default_template_yaml' 2026-09-01T00:16:51,194 adding 'lm_eval/tasks/aclue/_generate_configs.py' 2026-09-01T00:16:51,195 adding 'lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml' 2026-09-01T00:16:51,196 adding 'lm_eval/tasks/aclue/aclue_ancient_literature.yaml' 2026-09-01T00:16:51,197 adding 'lm_eval/tasks/aclue/aclue_ancient_medical.yaml' 2026-09-01T00:16:51,199 adding 'lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml' 2026-09-01T00:16:51,200 adding 'lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml' 2026-09-01T00:16:51,201 adding 'lm_eval/tasks/aclue/aclue_couplet_prediction.yaml' 2026-09-01T00:16:51,202 adding 'lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml' 2026-09-01T00:16:51,203 adding 'lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml' 2026-09-01T00:16:51,204 adding 'lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml' 2026-09-01T00:16:51,206 adding 'lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml' 2026-09-01T00:16:51,207 adding 'lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml' 2026-09-01T00:16:51,208 adding 'lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml' 2026-09-01T00:16:51,209 adding 'lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml' 2026-09-01T00:16:51,210 adding 'lm_eval/tasks/aclue/aclue_reading_comprehension.yaml' 2026-09-01T00:16:51,212 adding 'lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml' 2026-09-01T00:16:51,214 adding 'lm_eval/tasks/acpbench/README.md' 2026-09-01T00:16:51,216 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/_boolq_cot_2shot_yaml' 2026-09-01T00:16:51,218 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/act_reach.yaml' 2026-09-01T00:16:51,219 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/app.yaml' 2026-09-01T00:16:51,220 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/just.yaml' 2026-09-01T00:16:51,222 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/land.yaml' 2026-09-01T00:16:51,223 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/prog.yaml' 2026-09-01T00:16:51,224 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/reach.yaml' 2026-09-01T00:16:51,226 adding 'lm_eval/tasks/acpbench/boolq_cot_2shot/val.yaml' 2026-09-01T00:16:51,228 adding 'lm_eval/tasks/acpbench/gen_2shot/_gen_yaml_2shot' 2026-09-01T00:16:51,229 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_grammar.lark' 2026-09-01T00:16:51,233 adding 'lm_eval/tasks/acpbench/gen_2shot/acp_utils.py' 2026-09-01T00:16:51,235 adding 'lm_eval/tasks/acpbench/gen_2shot/act_reach.yaml' 2026-09-01T00:16:51,236 adding 'lm_eval/tasks/acpbench/gen_2shot/app.yaml' 2026-09-01T00:16:51,238 adding 'lm_eval/tasks/acpbench/gen_2shot/just.yaml' 2026-09-01T00:16:51,239 adding 'lm_eval/tasks/acpbench/gen_2shot/land.yaml' 2026-09-01T00:16:51,241 adding 'lm_eval/tasks/acpbench/gen_2shot/next_act.yaml' 2026-09-01T00:16:51,242 adding 'lm_eval/tasks/acpbench/gen_2shot/prog.yaml' 2026-09-01T00:16:51,244 adding 'lm_eval/tasks/acpbench/gen_2shot/reach.yaml' 2026-09-01T00:16:51,245 adding 'lm_eval/tasks/acpbench/gen_2shot/val.yaml' 2026-09-01T00:16:51,247 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/_gen_yaml_2shot' 2026-09-01T00:16:51,249 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_grammar.lark' 2026-09-01T00:16:51,253 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/acp_utils.py' 2026-09-01T00:16:51,255 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/act_reach.yaml' 2026-09-01T00:16:51,257 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/app.yaml' 2026-09-01T00:16:51,259 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/just.yaml' 2026-09-01T00:16:51,267 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/land.yaml' 2026-09-01T00:16:51,269 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/next_act.yaml' 2026-09-01T00:16:51,271 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/prog.yaml' 2026-09-01T00:16:51,272 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/reach.yaml' 2026-09-01T00:16:51,274 adding 'lm_eval/tasks/acpbench/gen_2shot_with_pddl/val.yaml' 2026-09-01T00:16:51,276 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/_mcq_cot_2shot_yaml' 2026-09-01T00:16:51,278 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/act_reach.yaml' 2026-09-01T00:16:51,279 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/app.yaml' 2026-09-01T00:16:51,280 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/just.yaml' 2026-09-01T00:16:51,282 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/land.yaml' 2026-09-01T00:16:51,283 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/prog.yaml' 2026-09-01T00:16:51,284 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/reach.yaml' 2026-09-01T00:16:51,286 adding 'lm_eval/tasks/acpbench/mcq_cot_2shot/val.yaml' 2026-09-01T00:16:51,288 adding 'lm_eval/tasks/aexams/README.md' 2026-09-01T00:16:51,289 adding 'lm_eval/tasks/aexams/_aexams.yaml' 2026-09-01T00:16:51,290 adding 'lm_eval/tasks/aexams/_default_template_yaml' 2026-09-01T00:16:51,292 adding 'lm_eval/tasks/aexams/aexams_Biology.yaml' 2026-09-01T00:16:51,293 adding 'lm_eval/tasks/aexams/aexams_IslamicStudies.yaml' 2026-09-01T00:16:51,294 adding 'lm_eval/tasks/aexams/aexams_Physics.yaml' 2026-09-01T00:16:51,295 adding 'lm_eval/tasks/aexams/aexams_Science.yaml' 2026-09-01T00:16:51,296 adding 'lm_eval/tasks/aexams/aexams_Social.yaml' 2026-09-01T00:16:51,298 adding 'lm_eval/tasks/afrimgsm/README.md' 2026-09-01T00:16:51,300 adding 'lm_eval/tasks/afrimgsm/gen_utils.py' 2026-09-01T00:16:51,301 adding 'lm_eval/tasks/afrimgsm/gen_yaml.sh' 2026-09-01T00:16:51,302 adding 'lm_eval/tasks/afrimgsm/run.sh' 2026-09-01T00:16:51,304 adding 'lm_eval/tasks/afrimgsm/utils.py' 2026-09-01T00:16:51,305 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm.yaml' 2026-09-01T00:16:51,307 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_amh.yaml' 2026-09-01T00:16:51,308 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_eng.yaml' 2026-09-01T00:16:51,309 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ewe.yaml' 2026-09-01T00:16:51,310 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_fra.yaml' 2026-09-01T00:16:51,312 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_hau.yaml' 2026-09-01T00:16:51,313 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_ibo.yaml' 2026-09-01T00:16:51,314 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_kin.yaml' 2026-09-01T00:16:51,315 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lin.yaml' 2026-09-01T00:16:51,316 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_lug.yaml' 2026-09-01T00:16:51,317 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_orm.yaml' 2026-09-01T00:16:51,318 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sna.yaml' 2026-09-01T00:16:51,320 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_sot.yaml' 2026-09-01T00:16:51,321 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_swa.yaml' 2026-09-01T00:16:51,322 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_twi.yaml' 2026-09-01T00:16:51,323 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_vai.yaml' 2026-09-01T00:16:51,324 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_wol.yaml' 2026-09-01T00:16:51,325 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_xho.yaml' 2026-09-01T00:16:51,326 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yaml' 2026-09-01T00:16:51,327 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_yor.yaml' 2026-09-01T00:16:51,328 adding 'lm_eval/tasks/afrimgsm/direct/prompt_1/afrimgsm_zul.yaml' 2026-09-01T00:16:51,330 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_amh.yaml' 2026-09-01T00:16:51,331 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_eng.yaml' 2026-09-01T00:16:51,332 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ewe.yaml' 2026-09-01T00:16:51,333 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_fra.yaml' 2026-09-01T00:16:51,334 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_hau.yaml' 2026-09-01T00:16:51,335 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_ibo.yaml' 2026-09-01T00:16:51,336 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_kin.yaml' 2026-09-01T00:16:51,338 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lin.yaml' 2026-09-01T00:16:51,339 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_lug.yaml' 2026-09-01T00:16:51,340 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_orm.yaml' 2026-09-01T00:16:51,341 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sna.yaml' 2026-09-01T00:16:51,342 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_sot.yaml' 2026-09-01T00:16:51,343 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_swa.yaml' 2026-09-01T00:16:51,344 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_twi.yaml' 2026-09-01T00:16:51,346 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_vai.yaml' 2026-09-01T00:16:51,347 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_wol.yaml' 2026-09-01T00:16:51,348 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_xho.yaml' 2026-09-01T00:16:51,349 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yaml' 2026-09-01T00:16:51,350 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_yor.yaml' 2026-09-01T00:16:51,351 adding 'lm_eval/tasks/afrimgsm/direct/prompt_2/afrimgsm_zul.yaml' 2026-09-01T00:16:51,353 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_amh.yaml' 2026-09-01T00:16:51,354 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_eng.yaml' 2026-09-01T00:16:51,355 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ewe.yaml' 2026-09-01T00:16:51,357 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_fra.yaml' 2026-09-01T00:16:51,358 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_hau.yaml' 2026-09-01T00:16:51,359 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_ibo.yaml' 2026-09-01T00:16:51,360 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_kin.yaml' 2026-09-01T00:16:51,361 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lin.yaml' 2026-09-01T00:16:51,362 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_lug.yaml' 2026-09-01T00:16:51,363 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_orm.yaml' 2026-09-01T00:16:51,365 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sna.yaml' 2026-09-01T00:16:51,366 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_sot.yaml' 2026-09-01T00:16:51,367 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_swa.yaml' 2026-09-01T00:16:51,368 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_twi.yaml' 2026-09-01T00:16:51,369 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_vai.yaml' 2026-09-01T00:16:51,371 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_wol.yaml' 2026-09-01T00:16:51,372 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_xho.yaml' 2026-09-01T00:16:51,373 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yaml' 2026-09-01T00:16:51,374 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_yor.yaml' 2026-09-01T00:16:51,375 adding 'lm_eval/tasks/afrimgsm/direct/prompt_3/afrimgsm_zul.yaml' 2026-09-01T00:16:51,377 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_amh.yaml' 2026-09-01T00:16:51,378 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_eng.yaml' 2026-09-01T00:16:51,380 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ewe.yaml' 2026-09-01T00:16:51,381 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_fra.yaml' 2026-09-01T00:16:51,382 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_hau.yaml' 2026-09-01T00:16:51,383 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_ibo.yaml' 2026-09-01T00:16:51,384 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_kin.yaml' 2026-09-01T00:16:51,385 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lin.yaml' 2026-09-01T00:16:51,387 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_lug.yaml' 2026-09-01T00:16:51,388 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_orm.yaml' 2026-09-01T00:16:51,389 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sna.yaml' 2026-09-01T00:16:51,390 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_sot.yaml' 2026-09-01T00:16:51,391 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_swa.yaml' 2026-09-01T00:16:51,392 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_twi.yaml' 2026-09-01T00:16:51,394 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_vai.yaml' 2026-09-01T00:16:51,395 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_wol.yaml' 2026-09-01T00:16:51,396 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_xho.yaml' 2026-09-01T00:16:51,397 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yaml' 2026-09-01T00:16:51,398 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_yor.yaml' 2026-09-01T00:16:51,400 adding 'lm_eval/tasks/afrimgsm/direct/prompt_4/afrimgsm_zul.yaml' 2026-09-01T00:16:51,401 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_amh.yaml' 2026-09-01T00:16:51,403 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_eng.yaml' 2026-09-01T00:16:51,404 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ewe.yaml' 2026-09-01T00:16:51,405 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_fra.yaml' 2026-09-01T00:16:51,406 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_hau.yaml' 2026-09-01T00:16:51,407 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_ibo.yaml' 2026-09-01T00:16:51,409 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_kin.yaml' 2026-09-01T00:16:51,410 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lin.yaml' 2026-09-01T00:16:51,411 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_lug.yaml' 2026-09-01T00:16:51,412 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_orm.yaml' 2026-09-01T00:16:51,414 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sna.yaml' 2026-09-01T00:16:51,415 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_sot.yaml' 2026-09-01T00:16:51,416 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_swa.yaml' 2026-09-01T00:16:51,417 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_twi.yaml' 2026-09-01T00:16:51,419 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_vai.yaml' 2026-09-01T00:16:51,420 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_wol.yaml' 2026-09-01T00:16:51,421 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_xho.yaml' 2026-09-01T00:16:51,422 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yaml' 2026-09-01T00:16:51,424 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_yor.yaml' 2026-09-01T00:16:51,425 adding 'lm_eval/tasks/afrimgsm/direct/prompt_5/afrimgsm_zul.yaml' 2026-09-01T00:16:51,427 adding 'lm_eval/tasks/afrimgsm/direct_cot/afrimgsm_cot.yaml' 2026-09-01T00:16:51,428 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_amh.yaml' 2026-09-01T00:16:51,430 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_eng.yaml' 2026-09-01T00:16:51,431 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ewe.yaml' 2026-09-01T00:16:51,432 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_fra.yaml' 2026-09-01T00:16:51,433 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_hau.yaml' 2026-09-01T00:16:51,434 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_ibo.yaml' 2026-09-01T00:16:51,435 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_kin.yaml' 2026-09-01T00:16:51,436 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lin.yaml' 2026-09-01T00:16:51,438 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_lug.yaml' 2026-09-01T00:16:51,439 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_orm.yaml' 2026-09-01T00:16:51,440 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sna.yaml' 2026-09-01T00:16:51,441 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_sot.yaml' 2026-09-01T00:16:51,442 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_swa.yaml' 2026-09-01T00:16:51,443 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_twi.yaml' 2026-09-01T00:16:51,444 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_vai.yaml' 2026-09-01T00:16:51,445 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_wol.yaml' 2026-09-01T00:16:51,447 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_xho.yaml' 2026-09-01T00:16:51,448 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yaml' 2026-09-01T00:16:51,449 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_yor.yaml' 2026-09-01T00:16:51,450 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_1/afrimgsm_cot_zul.yaml' 2026-09-01T00:16:51,452 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_amh.yaml' 2026-09-01T00:16:51,453 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_eng.yaml' 2026-09-01T00:16:51,454 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ewe.yaml' 2026-09-01T00:16:51,455 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_fra.yaml' 2026-09-01T00:16:51,456 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_hau.yaml' 2026-09-01T00:16:51,458 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_ibo.yaml' 2026-09-01T00:16:51,459 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_kin.yaml' 2026-09-01T00:16:51,460 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lin.yaml' 2026-09-01T00:16:51,461 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_lug.yaml' 2026-09-01T00:16:51,462 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_orm.yaml' 2026-09-01T00:16:51,463 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sna.yaml' 2026-09-01T00:16:51,464 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_sot.yaml' 2026-09-01T00:16:51,466 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_swa.yaml' 2026-09-01T00:16:51,467 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_twi.yaml' 2026-09-01T00:16:51,468 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_vai.yaml' 2026-09-01T00:16:51,469 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_wol.yaml' 2026-09-01T00:16:51,470 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_xho.yaml' 2026-09-01T00:16:51,472 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yaml' 2026-09-01T00:16:51,473 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_yor.yaml' 2026-09-01T00:16:51,474 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_2/afrimgsm_cot_zul.yaml' 2026-09-01T00:16:51,476 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_amh.yaml' 2026-09-01T00:16:51,477 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_eng.yaml' 2026-09-01T00:16:51,478 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ewe.yaml' 2026-09-01T00:16:51,479 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_fra.yaml' 2026-09-01T00:16:51,481 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_hau.yaml' 2026-09-01T00:16:51,482 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_ibo.yaml' 2026-09-01T00:16:51,483 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_kin.yaml' 2026-09-01T00:16:51,484 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lin.yaml' 2026-09-01T00:16:51,486 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_lug.yaml' 2026-09-01T00:16:51,487 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_orm.yaml' 2026-09-01T00:16:51,488 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sna.yaml' 2026-09-01T00:16:51,489 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_sot.yaml' 2026-09-01T00:16:51,490 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_swa.yaml' 2026-09-01T00:16:51,491 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_twi.yaml' 2026-09-01T00:16:51,492 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_vai.yaml' 2026-09-01T00:16:51,493 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_wol.yaml' 2026-09-01T00:16:51,494 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_xho.yaml' 2026-09-01T00:16:51,496 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yaml' 2026-09-01T00:16:51,497 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_yor.yaml' 2026-09-01T00:16:51,498 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_3/afrimgsm_cot_zul.yaml' 2026-09-01T00:16:51,500 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_amh.yaml' 2026-09-01T00:16:51,501 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_eng.yaml' 2026-09-01T00:16:51,502 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ewe.yaml' 2026-09-01T00:16:51,503 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_fra.yaml' 2026-09-01T00:16:51,504 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_hau.yaml' 2026-09-01T00:16:51,506 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_ibo.yaml' 2026-09-01T00:16:51,507 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_kin.yaml' 2026-09-01T00:16:51,508 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lin.yaml' 2026-09-01T00:16:51,509 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_lug.yaml' 2026-09-01T00:16:51,510 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_orm.yaml' 2026-09-01T00:16:51,512 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sna.yaml' 2026-09-01T00:16:51,513 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_sot.yaml' 2026-09-01T00:16:51,514 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_swa.yaml' 2026-09-01T00:16:51,515 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_twi.yaml' 2026-09-01T00:16:51,517 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_vai.yaml' 2026-09-01T00:16:51,518 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_wol.yaml' 2026-09-01T00:16:51,519 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_xho.yaml' 2026-09-01T00:16:51,521 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yaml' 2026-09-01T00:16:51,522 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_yor.yaml' 2026-09-01T00:16:51,523 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_4/afrimgsm_cot_zul.yaml' 2026-09-01T00:16:51,525 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_amh.yaml' 2026-09-01T00:16:51,526 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_eng.yaml' 2026-09-01T00:16:51,528 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ewe.yaml' 2026-09-01T00:16:51,529 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_fra.yaml' 2026-09-01T00:16:51,530 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_hau.yaml' 2026-09-01T00:16:51,531 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_ibo.yaml' 2026-09-01T00:16:51,533 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_kin.yaml' 2026-09-01T00:16:51,534 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lin.yaml' 2026-09-01T00:16:51,535 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_lug.yaml' 2026-09-01T00:16:51,536 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_orm.yaml' 2026-09-01T00:16:51,537 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sna.yaml' 2026-09-01T00:16:51,538 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_sot.yaml' 2026-09-01T00:16:51,540 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_swa.yaml' 2026-09-01T00:16:51,541 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_twi.yaml' 2026-09-01T00:16:51,542 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_vai.yaml' 2026-09-01T00:16:51,543 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_wol.yaml' 2026-09-01T00:16:51,544 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_xho.yaml' 2026-09-01T00:16:51,546 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yaml' 2026-09-01T00:16:51,547 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_yor.yaml' 2026-09-01T00:16:51,548 adding 'lm_eval/tasks/afrimgsm/direct_cot/prompt_5/afrimgsm_cot_zul.yaml' 2026-09-01T00:16:51,550 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_tt.yaml' 2026-09-01T00:16:51,551 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_amh.yaml' 2026-09-01T00:16:51,552 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ewe.yaml' 2026-09-01T00:16:51,554 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_fra.yaml' 2026-09-01T00:16:51,555 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_hau.yaml' 2026-09-01T00:16:51,556 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_ibo.yaml' 2026-09-01T00:16:51,557 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_kin.yaml' 2026-09-01T00:16:51,558 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lin.yaml' 2026-09-01T00:16:51,559 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_lug.yaml' 2026-09-01T00:16:51,561 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_orm.yaml' 2026-09-01T00:16:51,562 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sna.yaml' 2026-09-01T00:16:51,563 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_sot.yaml' 2026-09-01T00:16:51,564 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_swa.yaml' 2026-09-01T00:16:51,565 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_twi.yaml' 2026-09-01T00:16:51,566 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_wol.yaml' 2026-09-01T00:16:51,568 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_xho.yaml' 2026-09-01T00:16:51,569 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yaml' 2026-09-01T00:16:51,570 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_yor.yaml' 2026-09-01T00:16:51,571 adding 'lm_eval/tasks/afrimgsm/translate/prompt_1/afrimgsm_translate_zul.yaml' 2026-09-01T00:16:51,573 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_amh.yaml' 2026-09-01T00:16:51,574 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ewe.yaml' 2026-09-01T00:16:51,575 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_fra.yaml' 2026-09-01T00:16:51,577 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_hau.yaml' 2026-09-01T00:16:51,578 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_ibo.yaml' 2026-09-01T00:16:51,579 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_kin.yaml' 2026-09-01T00:16:51,580 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lin.yaml' 2026-09-01T00:16:51,581 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_lug.yaml' 2026-09-01T00:16:51,582 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_orm.yaml' 2026-09-01T00:16:51,583 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sna.yaml' 2026-09-01T00:16:51,584 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_sot.yaml' 2026-09-01T00:16:51,586 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_swa.yaml' 2026-09-01T00:16:51,587 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_twi.yaml' 2026-09-01T00:16:51,588 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_wol.yaml' 2026-09-01T00:16:51,589 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_xho.yaml' 2026-09-01T00:16:51,590 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yaml' 2026-09-01T00:16:51,591 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_yor.yaml' 2026-09-01T00:16:51,593 adding 'lm_eval/tasks/afrimgsm/translate/prompt_2/afrimgsm_translate_zul.yaml' 2026-09-01T00:16:51,595 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_amh.yaml' 2026-09-01T00:16:51,596 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ewe.yaml' 2026-09-01T00:16:51,597 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_fra.yaml' 2026-09-01T00:16:51,598 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_hau.yaml' 2026-09-01T00:16:51,599 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_ibo.yaml' 2026-09-01T00:16:51,600 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_kin.yaml' 2026-09-01T00:16:51,602 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lin.yaml' 2026-09-01T00:16:51,603 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_lug.yaml' 2026-09-01T00:16:51,604 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_orm.yaml' 2026-09-01T00:16:51,605 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sna.yaml' 2026-09-01T00:16:51,606 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_sot.yaml' 2026-09-01T00:16:51,607 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_swa.yaml' 2026-09-01T00:16:51,609 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_twi.yaml' 2026-09-01T00:16:51,610 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_wol.yaml' 2026-09-01T00:16:51,611 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_xho.yaml' 2026-09-01T00:16:51,612 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yaml' 2026-09-01T00:16:51,613 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_yor.yaml' 2026-09-01T00:16:51,615 adding 'lm_eval/tasks/afrimgsm/translate/prompt_3/afrimgsm_translate_zul.yaml' 2026-09-01T00:16:51,616 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_amh.yaml' 2026-09-01T00:16:51,618 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ewe.yaml' 2026-09-01T00:16:51,619 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_fra.yaml' 2026-09-01T00:16:51,620 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_hau.yaml' 2026-09-01T00:16:51,621 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_ibo.yaml' 2026-09-01T00:16:51,622 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_kin.yaml' 2026-09-01T00:16:51,624 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lin.yaml' 2026-09-01T00:16:51,625 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_lug.yaml' 2026-09-01T00:16:51,626 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_orm.yaml' 2026-09-01T00:16:51,627 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sna.yaml' 2026-09-01T00:16:51,628 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_sot.yaml' 2026-09-01T00:16:51,629 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_swa.yaml' 2026-09-01T00:16:51,630 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_twi.yaml' 2026-09-01T00:16:51,631 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_wol.yaml' 2026-09-01T00:16:51,633 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_xho.yaml' 2026-09-01T00:16:51,634 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yaml' 2026-09-01T00:16:51,635 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_yor.yaml' 2026-09-01T00:16:51,636 adding 'lm_eval/tasks/afrimgsm/translate/prompt_4/afrimgsm_translate_zul.yaml' 2026-09-01T00:16:51,638 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_amh.yaml' 2026-09-01T00:16:51,639 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ewe.yaml' 2026-09-01T00:16:51,640 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_fra.yaml' 2026-09-01T00:16:51,642 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_hau.yaml' 2026-09-01T00:16:51,643 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_ibo.yaml' 2026-09-01T00:16:51,644 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_kin.yaml' 2026-09-01T00:16:51,645 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lin.yaml' 2026-09-01T00:16:51,647 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_lug.yaml' 2026-09-01T00:16:51,648 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_orm.yaml' 2026-09-01T00:16:51,649 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sna.yaml' 2026-09-01T00:16:51,650 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_sot.yaml' 2026-09-01T00:16:51,651 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_swa.yaml' 2026-09-01T00:16:51,652 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_twi.yaml' 2026-09-01T00:16:51,654 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_wol.yaml' 2026-09-01T00:16:51,655 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_xho.yaml' 2026-09-01T00:16:51,656 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yaml' 2026-09-01T00:16:51,657 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_yor.yaml' 2026-09-01T00:16:51,658 adding 'lm_eval/tasks/afrimgsm/translate/prompt_5/afrimgsm_translate_zul.yaml' 2026-09-01T00:16:51,660 adding 'lm_eval/tasks/afrimgsm/translate_cot/afrimgsm_tt_cot.yaml' 2026-09-01T00:16:51,662 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:16:51,664 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:16:51,665 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:16:51,666 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:16:51,667 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:16:51,668 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:16:51,670 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:16:51,671 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:16:51,672 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:16:51,673 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:16:51,674 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:16:51,676 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:16:51,677 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:16:51,678 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:16:51,679 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:16:51,680 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:16:51,681 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yaml' 2026-09-01T00:16:51,682 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:16:51,684 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_1/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:16:51,685 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:16:51,686 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:16:51,688 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:16:51,689 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:16:51,716 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:16:51,717 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:16:51,718 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:16:51,719 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:16:51,720 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:16:51,721 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:16:51,723 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:16:51,724 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:16:51,725 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:16:51,726 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:16:51,727 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:16:51,728 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:16:51,730 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yaml' 2026-09-01T00:16:51,731 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:16:51,732 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_2/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:16:51,734 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:16:51,735 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:16:51,736 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:16:51,737 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:16:51,738 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:16:51,740 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:16:51,741 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:16:51,742 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:16:51,743 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:16:51,744 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:16:51,745 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:16:51,746 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:16:51,748 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:16:51,749 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:16:51,750 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:16:51,751 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:16:51,752 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yaml' 2026-09-01T00:16:51,753 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:16:51,754 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_3/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:16:51,756 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:16:51,757 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:16:51,759 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:16:51,760 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:16:51,761 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:16:51,762 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:16:51,763 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:16:51,765 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:16:51,766 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:16:51,767 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:16:51,768 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:16:51,769 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:16:51,771 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:16:51,772 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:16:51,773 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:16:51,774 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:16:51,775 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yaml' 2026-09-01T00:16:51,777 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:16:51,778 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_4/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:16:51,780 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_amh.yaml' 2026-09-01T00:16:51,781 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ewe.yaml' 2026-09-01T00:16:51,782 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_fra.yaml' 2026-09-01T00:16:51,784 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_hau.yaml' 2026-09-01T00:16:51,785 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_ibo.yaml' 2026-09-01T00:16:51,786 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_kin.yaml' 2026-09-01T00:16:51,787 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lin.yaml' 2026-09-01T00:16:51,788 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_lug.yaml' 2026-09-01T00:16:51,790 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_orm.yaml' 2026-09-01T00:16:51,791 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sna.yaml' 2026-09-01T00:16:51,792 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_sot.yaml' 2026-09-01T00:16:51,793 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_swa.yaml' 2026-09-01T00:16:51,794 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_twi.yaml' 2026-09-01T00:16:51,795 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_vai.yaml' 2026-09-01T00:16:51,796 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_wol.yaml' 2026-09-01T00:16:51,797 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_xho.yaml' 2026-09-01T00:16:51,798 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yaml' 2026-09-01T00:16:51,800 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_yor.yaml' 2026-09-01T00:16:51,801 adding 'lm_eval/tasks/afrimgsm/translate_cot/prompt_5/afrimgsm_cot_translate_zul.yaml' 2026-09-01T00:16:51,803 adding 'lm_eval/tasks/afrimmlu/README.md' 2026-09-01T00:16:51,804 adding 'lm_eval/tasks/afrimmlu/fewshot.sh' 2026-09-01T00:16:51,806 adding 'lm_eval/tasks/afrimmlu/gen_utils.py' 2026-09-01T00:16:51,807 adding 'lm_eval/tasks/afrimmlu/utils.py' 2026-09-01T00:16:51,808 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu.yaml' 2026-09-01T00:16:51,810 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct' 2026-09-01T00:16:51,812 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_amh.yaml' 2026-09-01T00:16:51,813 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_eng.yaml' 2026-09-01T00:16:51,814 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ewe.yaml' 2026-09-01T00:16:51,815 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_fra.yaml' 2026-09-01T00:16:51,816 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_hau.yaml' 2026-09-01T00:16:51,817 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_ibo.yaml' 2026-09-01T00:16:51,818 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_kin.yaml' 2026-09-01T00:16:51,819 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lin.yaml' 2026-09-01T00:16:51,821 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_lug.yaml' 2026-09-01T00:16:51,822 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_orm.yaml' 2026-09-01T00:16:51,823 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sna.yaml' 2026-09-01T00:16:51,824 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_sot.yaml' 2026-09-01T00:16:51,825 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_swa.yaml' 2026-09-01T00:16:51,826 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_twi.yaml' 2026-09-01T00:16:51,827 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_wol.yaml' 2026-09-01T00:16:51,829 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_xho.yaml' 2026-09-01T00:16:51,830 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_yor.yaml' 2026-09-01T00:16:51,831 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/afrimmlu_direct_zul.yaml' 2026-09-01T00:16:51,832 adding 'lm_eval/tasks/afrimmlu/direct/prompt_1/utils.py' 2026-09-01T00:16:51,834 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct' 2026-09-01T00:16:51,835 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_amh.yaml' 2026-09-01T00:16:51,836 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_eng.yaml' 2026-09-01T00:16:51,837 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ewe.yaml' 2026-09-01T00:16:51,839 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_fra.yaml' 2026-09-01T00:16:51,840 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_hau.yaml' 2026-09-01T00:16:51,841 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_ibo.yaml' 2026-09-01T00:16:51,842 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_kin.yaml' 2026-09-01T00:16:51,843 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lin.yaml' 2026-09-01T00:16:51,844 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_lug.yaml' 2026-09-01T00:16:51,845 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_orm.yaml' 2026-09-01T00:16:51,846 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sna.yaml' 2026-09-01T00:16:51,847 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_sot.yaml' 2026-09-01T00:16:51,848 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_swa.yaml' 2026-09-01T00:16:51,849 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_twi.yaml' 2026-09-01T00:16:51,850 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_wol.yaml' 2026-09-01T00:16:51,851 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_xho.yaml' 2026-09-01T00:16:51,852 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_yor.yaml' 2026-09-01T00:16:51,853 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/afrimmlu_direct_zul.yaml' 2026-09-01T00:16:51,855 adding 'lm_eval/tasks/afrimmlu/direct/prompt_2/utils.py' 2026-09-01T00:16:51,856 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct' 2026-09-01T00:16:51,858 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_amh.yaml' 2026-09-01T00:16:51,859 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_eng.yaml' 2026-09-01T00:16:51,860 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ewe.yaml' 2026-09-01T00:16:51,861 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_fra.yaml' 2026-09-01T00:16:51,862 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_hau.yaml' 2026-09-01T00:16:51,863 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_ibo.yaml' 2026-09-01T00:16:51,864 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_kin.yaml' 2026-09-01T00:16:51,865 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lin.yaml' 2026-09-01T00:16:51,866 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_lug.yaml' 2026-09-01T00:16:51,868 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_orm.yaml' 2026-09-01T00:16:51,869 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sna.yaml' 2026-09-01T00:16:51,870 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_sot.yaml' 2026-09-01T00:16:51,871 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_swa.yaml' 2026-09-01T00:16:51,872 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_twi.yaml' 2026-09-01T00:16:51,873 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_wol.yaml' 2026-09-01T00:16:51,874 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_xho.yaml' 2026-09-01T00:16:51,875 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_yor.yaml' 2026-09-01T00:16:51,877 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/afrimmlu_direct_zul.yaml' 2026-09-01T00:16:51,878 adding 'lm_eval/tasks/afrimmlu/direct/prompt_3/utils.py' 2026-09-01T00:16:51,880 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct' 2026-09-01T00:16:51,881 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_amh.yaml' 2026-09-01T00:16:51,882 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_eng.yaml' 2026-09-01T00:16:51,883 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ewe.yaml' 2026-09-01T00:16:51,884 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_fra.yaml' 2026-09-01T00:16:51,885 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_hau.yaml' 2026-09-01T00:16:51,887 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_ibo.yaml' 2026-09-01T00:16:51,888 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_kin.yaml' 2026-09-01T00:16:51,889 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lin.yaml' 2026-09-01T00:16:51,890 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_lug.yaml' 2026-09-01T00:16:51,891 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_orm.yaml' 2026-09-01T00:16:51,892 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sna.yaml' 2026-09-01T00:16:51,893 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_sot.yaml' 2026-09-01T00:16:51,894 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_swa.yaml' 2026-09-01T00:16:51,895 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_twi.yaml' 2026-09-01T00:16:51,896 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_wol.yaml' 2026-09-01T00:16:51,897 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_xho.yaml' 2026-09-01T00:16:51,898 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_yor.yaml' 2026-09-01T00:16:51,899 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/afrimmlu_direct_zul.yaml' 2026-09-01T00:16:51,901 adding 'lm_eval/tasks/afrimmlu/direct/prompt_4/utils.py' 2026-09-01T00:16:51,902 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct' 2026-09-01T00:16:51,904 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_amh.yaml' 2026-09-01T00:16:51,905 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_eng.yaml' 2026-09-01T00:16:51,906 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ewe.yaml' 2026-09-01T00:16:51,907 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_fra.yaml' 2026-09-01T00:16:51,908 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_hau.yaml' 2026-09-01T00:16:51,909 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_ibo.yaml' 2026-09-01T00:16:51,910 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_kin.yaml' 2026-09-01T00:16:51,911 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lin.yaml' 2026-09-01T00:16:51,913 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_lug.yaml' 2026-09-01T00:16:51,914 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_orm.yaml' 2026-09-01T00:16:51,915 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sna.yaml' 2026-09-01T00:16:51,916 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_sot.yaml' 2026-09-01T00:16:51,917 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_swa.yaml' 2026-09-01T00:16:51,918 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_twi.yaml' 2026-09-01T00:16:51,919 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_wol.yaml' 2026-09-01T00:16:51,921 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_xho.yaml' 2026-09-01T00:16:51,922 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_yor.yaml' 2026-09-01T00:16:51,923 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/afrimmlu_direct_zul.yaml' 2026-09-01T00:16:51,924 adding 'lm_eval/tasks/afrimmlu/direct/prompt_5/utils.py' 2026-09-01T00:16:51,926 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_tt.yaml' 2026-09-01T00:16:51,928 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate' 2026-09-01T00:16:51,929 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_amh.yaml' 2026-09-01T00:16:51,930 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ewe.yaml' 2026-09-01T00:16:51,931 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_fra.yaml' 2026-09-01T00:16:51,933 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_hau.yaml' 2026-09-01T00:16:51,934 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_ibo.yaml' 2026-09-01T00:16:51,935 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_kin.yaml' 2026-09-01T00:16:51,936 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lin.yaml' 2026-09-01T00:16:51,938 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_lug.yaml' 2026-09-01T00:16:51,939 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_orm.yaml' 2026-09-01T00:16:51,940 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sna.yaml' 2026-09-01T00:16:51,941 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_sot.yaml' 2026-09-01T00:16:51,942 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_swa.yaml' 2026-09-01T00:16:51,943 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_twi.yaml' 2026-09-01T00:16:51,944 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_wol.yaml' 2026-09-01T00:16:51,946 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_xho.yaml' 2026-09-01T00:16:51,947 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_yor.yaml' 2026-09-01T00:16:51,948 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/afrimmlu_translate_zul.yaml' 2026-09-01T00:16:51,949 adding 'lm_eval/tasks/afrimmlu/translate/prompt_1/utils.py' 2026-09-01T00:16:51,951 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate' 2026-09-01T00:16:51,952 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_amh.yaml' 2026-09-01T00:16:51,953 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ewe.yaml' 2026-09-01T00:16:51,954 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_fra.yaml' 2026-09-01T00:16:51,955 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_hau.yaml' 2026-09-01T00:16:51,956 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_ibo.yaml' 2026-09-01T00:16:51,957 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_kin.yaml' 2026-09-01T00:16:51,958 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lin.yaml' 2026-09-01T00:16:51,959 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_lug.yaml' 2026-09-01T00:16:51,961 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_orm.yaml' 2026-09-01T00:16:51,962 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sna.yaml' 2026-09-01T00:16:51,963 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_sot.yaml' 2026-09-01T00:16:51,964 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_swa.yaml' 2026-09-01T00:16:51,965 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_twi.yaml' 2026-09-01T00:16:51,966 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_wol.yaml' 2026-09-01T00:16:51,967 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_xho.yaml' 2026-09-01T00:16:51,969 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_yor.yaml' 2026-09-01T00:16:51,970 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/afrimmlu_translate_zul.yaml' 2026-09-01T00:16:51,971 adding 'lm_eval/tasks/afrimmlu/translate/prompt_2/utils.py' 2026-09-01T00:16:51,973 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate' 2026-09-01T00:16:51,974 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_amh.yaml' 2026-09-01T00:16:51,975 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ewe.yaml' 2026-09-01T00:16:51,976 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_fra.yaml' 2026-09-01T00:16:51,977 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_hau.yaml' 2026-09-01T00:16:51,978 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_ibo.yaml' 2026-09-01T00:16:51,979 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_kin.yaml' 2026-09-01T00:16:51,981 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lin.yaml' 2026-09-01T00:16:51,982 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_lug.yaml' 2026-09-01T00:16:51,983 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_orm.yaml' 2026-09-01T00:16:51,984 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sna.yaml' 2026-09-01T00:16:51,985 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_sot.yaml' 2026-09-01T00:16:51,986 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_swa.yaml' 2026-09-01T00:16:51,987 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_twi.yaml' 2026-09-01T00:16:51,988 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_wol.yaml' 2026-09-01T00:16:51,989 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_xho.yaml' 2026-09-01T00:16:51,990 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_yor.yaml' 2026-09-01T00:16:51,991 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/afrimmlu_translate_zul.yaml' 2026-09-01T00:16:51,993 adding 'lm_eval/tasks/afrimmlu/translate/prompt_3/utils.py' 2026-09-01T00:16:51,995 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate' 2026-09-01T00:16:51,996 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_amh.yaml' 2026-09-01T00:16:51,997 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ewe.yaml' 2026-09-01T00:16:51,998 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_fra.yaml' 2026-09-01T00:16:51,999 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_hau.yaml' 2026-09-01T00:16:52,000 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_ibo.yaml' 2026-09-01T00:16:52,001 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_kin.yaml' 2026-09-01T00:16:52,002 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lin.yaml' 2026-09-01T00:16:52,003 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_lug.yaml' 2026-09-01T00:16:52,005 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_orm.yaml' 2026-09-01T00:16:52,006 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sna.yaml' 2026-09-01T00:16:52,007 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_sot.yaml' 2026-09-01T00:16:52,008 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_swa.yaml' 2026-09-01T00:16:52,009 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_twi.yaml' 2026-09-01T00:16:52,010 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_wol.yaml' 2026-09-01T00:16:52,012 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_xho.yaml' 2026-09-01T00:16:52,013 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_yor.yaml' 2026-09-01T00:16:52,014 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/afrimmlu_translate_zul.yaml' 2026-09-01T00:16:52,016 adding 'lm_eval/tasks/afrimmlu/translate/prompt_4/utils.py' 2026-09-01T00:16:52,017 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate' 2026-09-01T00:16:52,019 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_amh.yaml' 2026-09-01T00:16:52,020 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ewe.yaml' 2026-09-01T00:16:52,021 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_fra.yaml' 2026-09-01T00:16:52,022 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_hau.yaml' 2026-09-01T00:16:52,023 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_ibo.yaml' 2026-09-01T00:16:52,024 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_kin.yaml' 2026-09-01T00:16:52,025 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lin.yaml' 2026-09-01T00:16:52,027 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_lug.yaml' 2026-09-01T00:16:52,028 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_orm.yaml' 2026-09-01T00:16:52,029 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sna.yaml' 2026-09-01T00:16:52,030 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_sot.yaml' 2026-09-01T00:16:52,031 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_swa.yaml' 2026-09-01T00:16:52,032 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_twi.yaml' 2026-09-01T00:16:52,033 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_wol.yaml' 2026-09-01T00:16:52,034 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_xho.yaml' 2026-09-01T00:16:52,035 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_yor.yaml' 2026-09-01T00:16:52,036 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/afrimmlu_translate_zul.yaml' 2026-09-01T00:16:52,037 adding 'lm_eval/tasks/afrimmlu/translate/prompt_5/utils.py' 2026-09-01T00:16:52,039 adding 'lm_eval/tasks/afrixnli/README.md' 2026-09-01T00:16:52,040 adding 'lm_eval/tasks/afrixnli/gen_utils.py' 2026-09-01T00:16:52,042 adding 'lm_eval/tasks/afrixnli/utils.py' 2026-09-01T00:16:52,044 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml' 2026-09-01T00:16:52,046 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml' 2026-09-01T00:16:52,047 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml' 2026-09-01T00:16:52,048 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml' 2026-09-01T00:16:52,049 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml' 2026-09-01T00:16:52,050 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml' 2026-09-01T00:16:52,051 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml' 2026-09-01T00:16:52,053 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml' 2026-09-01T00:16:52,054 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml' 2026-09-01T00:16:52,055 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml' 2026-09-01T00:16:52,056 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml' 2026-09-01T00:16:52,058 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml' 2026-09-01T00:16:52,059 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml' 2026-09-01T00:16:52,060 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml' 2026-09-01T00:16:52,061 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml' 2026-09-01T00:16:52,062 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml' 2026-09-01T00:16:52,063 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml' 2026-09-01T00:16:52,065 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml' 2026-09-01T00:16:52,066 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml' 2026-09-01T00:16:52,067 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py' 2026-09-01T00:16:52,069 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml' 2026-09-01T00:16:52,070 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml' 2026-09-01T00:16:52,071 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml' 2026-09-01T00:16:52,072 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml' 2026-09-01T00:16:52,074 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml' 2026-09-01T00:16:52,075 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml' 2026-09-01T00:16:52,076 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml' 2026-09-01T00:16:52,077 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml' 2026-09-01T00:16:52,079 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml' 2026-09-01T00:16:52,080 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml' 2026-09-01T00:16:52,081 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml' 2026-09-01T00:16:52,082 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml' 2026-09-01T00:16:52,083 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml' 2026-09-01T00:16:52,084 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml' 2026-09-01T00:16:52,085 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml' 2026-09-01T00:16:52,086 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml' 2026-09-01T00:16:52,087 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml' 2026-09-01T00:16:52,089 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml' 2026-09-01T00:16:52,090 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml' 2026-09-01T00:16:52,091 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py' 2026-09-01T00:16:52,093 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml' 2026-09-01T00:16:52,094 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml' 2026-09-01T00:16:52,095 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml' 2026-09-01T00:16:52,097 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml' 2026-09-01T00:16:52,098 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml' 2026-09-01T00:16:52,099 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml' 2026-09-01T00:16:52,100 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml' 2026-09-01T00:16:52,102 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml' 2026-09-01T00:16:52,103 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml' 2026-09-01T00:16:52,104 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml' 2026-09-01T00:16:52,105 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml' 2026-09-01T00:16:52,106 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml' 2026-09-01T00:16:52,107 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml' 2026-09-01T00:16:52,108 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml' 2026-09-01T00:16:52,110 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml' 2026-09-01T00:16:52,111 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml' 2026-09-01T00:16:52,112 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml' 2026-09-01T00:16:52,113 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml' 2026-09-01T00:16:52,114 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/utils.py' 2026-09-01T00:16:52,116 adding 'lm_eval/tasks/afrixnli/direct/afrixnli.yaml' 2026-09-01T00:16:52,118 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_amh.yaml' 2026-09-01T00:16:52,119 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_eng.yaml' 2026-09-01T00:16:52,120 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ewe.yaml' 2026-09-01T00:16:52,122 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_fra.yaml' 2026-09-01T00:16:52,123 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_hau.yaml' 2026-09-01T00:16:52,124 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_ibo.yaml' 2026-09-01T00:16:52,125 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_kin.yaml' 2026-09-01T00:16:52,126 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lin.yaml' 2026-09-01T00:16:52,128 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_lug.yaml' 2026-09-01T00:16:52,129 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_orm.yaml' 2026-09-01T00:16:52,130 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sna.yaml' 2026-09-01T00:16:52,131 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_sot.yaml' 2026-09-01T00:16:52,132 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_swa.yaml' 2026-09-01T00:16:52,133 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_twi.yaml' 2026-09-01T00:16:52,134 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_wol.yaml' 2026-09-01T00:16:52,135 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_xho.yaml' 2026-09-01T00:16:52,136 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yaml' 2026-09-01T00:16:52,138 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_yor.yaml' 2026-09-01T00:16:52,139 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/afrixnli_zul.yaml' 2026-09-01T00:16:52,140 adding 'lm_eval/tasks/afrixnli/direct/prompt_1/utils.py' 2026-09-01T00:16:52,142 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_amh.yaml' 2026-09-01T00:16:52,143 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_eng.yaml' 2026-09-01T00:16:52,144 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ewe.yaml' 2026-09-01T00:16:52,145 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_fra.yaml' 2026-09-01T00:16:52,146 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_hau.yaml' 2026-09-01T00:16:52,147 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_ibo.yaml' 2026-09-01T00:16:52,148 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_kin.yaml' 2026-09-01T00:16:52,150 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lin.yaml' 2026-09-01T00:16:52,151 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_lug.yaml' 2026-09-01T00:16:52,152 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_orm.yaml' 2026-09-01T00:16:52,153 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sna.yaml' 2026-09-01T00:16:52,154 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_sot.yaml' 2026-09-01T00:16:52,155 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_swa.yaml' 2026-09-01T00:16:52,156 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_twi.yaml' 2026-09-01T00:16:52,158 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_wol.yaml' 2026-09-01T00:16:52,159 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_xho.yaml' 2026-09-01T00:16:52,160 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yaml' 2026-09-01T00:16:52,161 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_yor.yaml' 2026-09-01T00:16:52,162 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/afrixnli_zul.yaml' 2026-09-01T00:16:52,163 adding 'lm_eval/tasks/afrixnli/direct/prompt_2/utils.py' 2026-09-01T00:16:52,165 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_amh.yaml' 2026-09-01T00:16:52,166 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_eng.yaml' 2026-09-01T00:16:52,168 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ewe.yaml' 2026-09-01T00:16:52,169 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_fra.yaml' 2026-09-01T00:16:52,170 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_hau.yaml' 2026-09-01T00:16:52,171 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_ibo.yaml' 2026-09-01T00:16:52,172 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_kin.yaml' 2026-09-01T00:16:52,174 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lin.yaml' 2026-09-01T00:16:52,175 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_lug.yaml' 2026-09-01T00:16:52,176 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_orm.yaml' 2026-09-01T00:16:52,177 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sna.yaml' 2026-09-01T00:16:52,178 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_sot.yaml' 2026-09-01T00:16:52,179 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_swa.yaml' 2026-09-01T00:16:52,181 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_twi.yaml' 2026-09-01T00:16:52,182 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_wol.yaml' 2026-09-01T00:16:52,183 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_xho.yaml' 2026-09-01T00:16:52,184 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yaml' 2026-09-01T00:16:52,185 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_yor.yaml' 2026-09-01T00:16:52,187 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/afrixnli_zul.yaml' 2026-09-01T00:16:52,188 adding 'lm_eval/tasks/afrixnli/direct/prompt_3/utils.py' 2026-09-01T00:16:52,190 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_amh.yaml' 2026-09-01T00:16:52,191 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_eng.yaml' 2026-09-01T00:16:52,192 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ewe.yaml' 2026-09-01T00:16:52,193 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_fra.yaml' 2026-09-01T00:16:52,194 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_hau.yaml' 2026-09-01T00:16:52,196 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_ibo.yaml' 2026-09-01T00:16:52,197 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_kin.yaml' 2026-09-01T00:16:52,198 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lin.yaml' 2026-09-01T00:16:52,199 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_lug.yaml' 2026-09-01T00:16:52,200 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_orm.yaml' 2026-09-01T00:16:52,201 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sna.yaml' 2026-09-01T00:16:52,203 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_sot.yaml' 2026-09-01T00:16:52,204 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_swa.yaml' 2026-09-01T00:16:52,205 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_twi.yaml' 2026-09-01T00:16:52,206 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_wol.yaml' 2026-09-01T00:16:52,207 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_xho.yaml' 2026-09-01T00:16:52,209 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yaml' 2026-09-01T00:16:52,210 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_yor.yaml' 2026-09-01T00:16:52,211 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/afrixnli_zul.yaml' 2026-09-01T00:16:52,212 adding 'lm_eval/tasks/afrixnli/direct/prompt_4/utils.py' 2026-09-01T00:16:52,214 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_amh.yaml' 2026-09-01T00:16:52,215 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_eng.yaml' 2026-09-01T00:16:52,217 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ewe.yaml' 2026-09-01T00:16:52,218 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_fra.yaml' 2026-09-01T00:16:52,219 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_hau.yaml' 2026-09-01T00:16:52,220 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_ibo.yaml' 2026-09-01T00:16:52,221 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_kin.yaml' 2026-09-01T00:16:52,222 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lin.yaml' 2026-09-01T00:16:52,224 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_lug.yaml' 2026-09-01T00:16:52,225 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_orm.yaml' 2026-09-01T00:16:52,226 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sna.yaml' 2026-09-01T00:16:52,228 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_sot.yaml' 2026-09-01T00:16:52,229 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_swa.yaml' 2026-09-01T00:16:52,230 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_twi.yaml' 2026-09-01T00:16:52,231 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_wol.yaml' 2026-09-01T00:16:52,232 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_xho.yaml' 2026-09-01T00:16:52,234 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yaml' 2026-09-01T00:16:52,235 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_yor.yaml' 2026-09-01T00:16:52,236 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/afrixnli_zul.yaml' 2026-09-01T00:16:52,237 adding 'lm_eval/tasks/afrixnli/direct/prompt_5/utils.py' 2026-09-01T00:16:52,239 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml' 2026-09-01T00:16:52,241 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml' 2026-09-01T00:16:52,242 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml' 2026-09-01T00:16:52,243 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml' 2026-09-01T00:16:52,244 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml' 2026-09-01T00:16:52,245 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml' 2026-09-01T00:16:52,246 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml' 2026-09-01T00:16:52,247 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml' 2026-09-01T00:16:52,249 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml' 2026-09-01T00:16:52,250 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml' 2026-09-01T00:16:52,251 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml' 2026-09-01T00:16:52,252 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml' 2026-09-01T00:16:52,253 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml' 2026-09-01T00:16:52,254 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml' 2026-09-01T00:16:52,255 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml' 2026-09-01T00:16:52,256 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml' 2026-09-01T00:16:52,258 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml' 2026-09-01T00:16:52,259 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml' 2026-09-01T00:16:52,260 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml' 2026-09-01T00:16:52,261 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/utils.py' 2026-09-01T00:16:52,263 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml' 2026-09-01T00:16:52,264 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml' 2026-09-01T00:16:52,266 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml' 2026-09-01T00:16:52,267 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml' 2026-09-01T00:16:52,268 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml' 2026-09-01T00:16:52,269 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml' 2026-09-01T00:16:52,270 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml' 2026-09-01T00:16:52,271 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml' 2026-09-01T00:16:52,272 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml' 2026-09-01T00:16:52,274 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml' 2026-09-01T00:16:52,275 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml' 2026-09-01T00:16:52,276 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml' 2026-09-01T00:16:52,277 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml' 2026-09-01T00:16:52,278 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml' 2026-09-01T00:16:52,280 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml' 2026-09-01T00:16:52,281 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml' 2026-09-01T00:16:52,282 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml' 2026-09-01T00:16:52,283 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml' 2026-09-01T00:16:52,284 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/utils.py' 2026-09-01T00:16:52,286 adding 'lm_eval/tasks/afrixnli/translate/afrixnli_tt.yaml' 2026-09-01T00:16:52,288 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_amh.yaml' 2026-09-01T00:16:52,289 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ewe.yaml' 2026-09-01T00:16:52,290 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_fra.yaml' 2026-09-01T00:16:52,292 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_hau.yaml' 2026-09-01T00:16:52,293 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_ibo.yaml' 2026-09-01T00:16:52,294 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_kin.yaml' 2026-09-01T00:16:52,295 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lin.yaml' 2026-09-01T00:16:52,296 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_lug.yaml' 2026-09-01T00:16:52,298 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_orm.yaml' 2026-09-01T00:16:52,299 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sna.yaml' 2026-09-01T00:16:52,300 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_sot.yaml' 2026-09-01T00:16:52,301 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_swa.yaml' 2026-09-01T00:16:52,302 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_twi.yaml' 2026-09-01T00:16:52,303 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_wol.yaml' 2026-09-01T00:16:52,305 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_xho.yaml' 2026-09-01T00:16:52,306 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yaml' 2026-09-01T00:16:52,307 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_yor.yaml' 2026-09-01T00:16:52,308 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/afrixnli_translate_zul.yaml' 2026-09-01T00:16:52,309 adding 'lm_eval/tasks/afrixnli/translate/prompt_1/utils.py' 2026-09-01T00:16:52,311 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_amh.yaml' 2026-09-01T00:16:52,312 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ewe.yaml' 2026-09-01T00:16:52,313 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_fra.yaml' 2026-09-01T00:16:52,314 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_hau.yaml' 2026-09-01T00:16:52,316 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_ibo.yaml' 2026-09-01T00:16:52,317 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_kin.yaml' 2026-09-01T00:16:52,318 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lin.yaml' 2026-09-01T00:16:52,319 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_lug.yaml' 2026-09-01T00:16:52,320 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_orm.yaml' 2026-09-01T00:16:52,321 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sna.yaml' 2026-09-01T00:16:52,323 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_sot.yaml' 2026-09-01T00:16:52,324 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_swa.yaml' 2026-09-01T00:16:52,325 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_twi.yaml' 2026-09-01T00:16:52,326 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_wol.yaml' 2026-09-01T00:16:52,327 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_xho.yaml' 2026-09-01T00:16:52,329 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yaml' 2026-09-01T00:16:52,330 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_yor.yaml' 2026-09-01T00:16:52,331 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/afrixnli_translate_zul.yaml' 2026-09-01T00:16:52,332 adding 'lm_eval/tasks/afrixnli/translate/prompt_2/utils.py' 2026-09-01T00:16:52,333 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_amh.yaml' 2026-09-01T00:16:52,335 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ewe.yaml' 2026-09-01T00:16:52,336 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_fra.yaml' 2026-09-01T00:16:52,337 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_hau.yaml' 2026-09-01T00:16:52,338 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_ibo.yaml' 2026-09-01T00:16:52,339 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_kin.yaml' 2026-09-01T00:16:52,340 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lin.yaml' 2026-09-01T00:16:52,342 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_lug.yaml' 2026-09-01T00:16:52,343 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_orm.yaml' 2026-09-01T00:16:52,344 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sna.yaml' 2026-09-01T00:16:52,345 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_sot.yaml' 2026-09-01T00:16:52,346 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_swa.yaml' 2026-09-01T00:16:52,347 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_twi.yaml' 2026-09-01T00:16:52,349 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_wol.yaml' 2026-09-01T00:16:52,350 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_xho.yaml' 2026-09-01T00:16:52,351 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yaml' 2026-09-01T00:16:52,352 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_yor.yaml' 2026-09-01T00:16:52,353 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/afrixnli_translate_zul.yaml' 2026-09-01T00:16:52,355 adding 'lm_eval/tasks/afrixnli/translate/prompt_3/utils.py' 2026-09-01T00:16:52,357 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_amh.yaml' 2026-09-01T00:16:52,358 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ewe.yaml' 2026-09-01T00:16:52,359 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_fra.yaml' 2026-09-01T00:16:52,360 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_hau.yaml' 2026-09-01T00:16:52,362 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_ibo.yaml' 2026-09-01T00:16:52,363 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_kin.yaml' 2026-09-01T00:16:52,364 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lin.yaml' 2026-09-01T00:16:52,366 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_lug.yaml' 2026-09-01T00:16:52,367 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_orm.yaml' 2026-09-01T00:16:52,368 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sna.yaml' 2026-09-01T00:16:52,369 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_sot.yaml' 2026-09-01T00:16:52,370 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_swa.yaml' 2026-09-01T00:16:52,372 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_twi.yaml' 2026-09-01T00:16:52,373 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_wol.yaml' 2026-09-01T00:16:52,374 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_xho.yaml' 2026-09-01T00:16:52,376 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yaml' 2026-09-01T00:16:52,377 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_yor.yaml' 2026-09-01T00:16:52,378 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/afrixnli_translate_zul.yaml' 2026-09-01T00:16:52,379 adding 'lm_eval/tasks/afrixnli/translate/prompt_4/utils.py' 2026-09-01T00:16:52,381 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_amh.yaml' 2026-09-01T00:16:52,382 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ewe.yaml' 2026-09-01T00:16:52,383 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_fra.yaml' 2026-09-01T00:16:52,384 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_hau.yaml' 2026-09-01T00:16:52,385 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_ibo.yaml' 2026-09-01T00:16:52,387 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_kin.yaml' 2026-09-01T00:16:52,388 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lin.yaml' 2026-09-01T00:16:52,389 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_lug.yaml' 2026-09-01T00:16:52,390 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_orm.yaml' 2026-09-01T00:16:52,391 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sna.yaml' 2026-09-01T00:16:52,392 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_sot.yaml' 2026-09-01T00:16:52,394 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_swa.yaml' 2026-09-01T00:16:52,395 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_twi.yaml' 2026-09-01T00:16:52,396 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_wol.yaml' 2026-09-01T00:16:52,397 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_xho.yaml' 2026-09-01T00:16:52,399 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yaml' 2026-09-01T00:16:52,400 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_yor.yaml' 2026-09-01T00:16:52,401 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/afrixnli_translate_zul.yaml' 2026-09-01T00:16:52,403 adding 'lm_eval/tasks/afrixnli/translate/prompt_5/utils.py' 2026-09-01T00:16:52,405 adding 'lm_eval/tasks/afrobench/README.md' 2026-09-01T00:16:52,406 adding 'lm_eval/tasks/afrobench/afrobench-lite.yaml' 2026-09-01T00:16:52,407 adding 'lm_eval/tasks/afrobench/afrobench.yaml' 2026-09-01T00:16:52,409 adding 'lm_eval/tasks/afrobench/adr/README.md' 2026-09-01T00:16:52,410 adding 'lm_eval/tasks/afrobench/adr/afridiacritics.yaml' 2026-09-01T00:16:52,412 adding 'lm_eval/tasks/afrobench/adr/gen_utils.py' 2026-09-01T00:16:52,413 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_bbj.yaml' 2026-09-01T00:16:52,415 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_fon.yaml' 2026-09-01T00:16:52,416 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_ibo.yaml' 2026-09-01T00:16:52,417 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_wol.yaml' 2026-09-01T00:16:52,418 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yaml' 2026-09-01T00:16:52,420 adding 'lm_eval/tasks/afrobench/adr/prompt_1/afridiacritics_yor.yaml' 2026-09-01T00:16:52,421 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_bbj.yaml' 2026-09-01T00:16:52,423 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_fon.yaml' 2026-09-01T00:16:52,424 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_ibo.yaml' 2026-09-01T00:16:52,426 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_wol.yaml' 2026-09-01T00:16:52,427 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yaml' 2026-09-01T00:16:52,429 adding 'lm_eval/tasks/afrobench/adr/prompt_2/afridiacritics_yor.yaml' 2026-09-01T00:16:52,430 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_bbj.yaml' 2026-09-01T00:16:52,432 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_fon.yaml' 2026-09-01T00:16:52,433 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_ibo.yaml' 2026-09-01T00:16:52,434 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_wol.yaml' 2026-09-01T00:16:52,435 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yaml' 2026-09-01T00:16:52,436 adding 'lm_eval/tasks/afrobench/adr/prompt_3/afridiacritics_yor.yaml' 2026-09-01T00:16:52,438 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_bbj.yaml' 2026-09-01T00:16:52,440 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_fon.yaml' 2026-09-01T00:16:52,442 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_ibo.yaml' 2026-09-01T00:16:52,443 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_wol.yaml' 2026-09-01T00:16:52,444 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yaml' 2026-09-01T00:16:52,445 adding 'lm_eval/tasks/afrobench/adr/prompt_4/afridiacritics_yor.yaml' 2026-09-01T00:16:52,447 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_bbj.yaml' 2026-09-01T00:16:52,448 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_fon.yaml' 2026-09-01T00:16:52,449 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_ibo.yaml' 2026-09-01T00:16:52,450 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_wol.yaml' 2026-09-01T00:16:52,452 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yaml' 2026-09-01T00:16:52,453 adding 'lm_eval/tasks/afrobench/adr/prompt_5/afridiacritics_yor.yaml' 2026-09-01T00:16:52,455 adding 'lm_eval/tasks/afrobench/afriqa/README.md' 2026-09-01T00:16:52,456 adding 'lm_eval/tasks/afrobench/afriqa/afriqa.yaml' 2026-09-01T00:16:52,457 adding 'lm_eval/tasks/afrobench/afriqa/utils.py' 2026-09-01T00:16:52,459 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa' 2026-09-01T00:16:52,460 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_bem.yaml' 2026-09-01T00:16:52,462 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_fon.yaml' 2026-09-01T00:16:52,463 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_hau.yaml' 2026-09-01T00:16:52,464 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_ibo.yaml' 2026-09-01T00:16:52,465 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_kin.yaml' 2026-09-01T00:16:52,467 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_swa.yaml' 2026-09-01T00:16:52,468 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_twi.yaml' 2026-09-01T00:16:52,469 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_yor.yaml' 2026-09-01T00:16:52,470 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/afriqa_zul.yaml' 2026-09-01T00:16:52,471 adding 'lm_eval/tasks/afrobench/afriqa/prompt_1/utils.py' 2026-09-01T00:16:52,473 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa' 2026-09-01T00:16:52,474 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_bem.yaml' 2026-09-01T00:16:52,476 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_fon.yaml' 2026-09-01T00:16:52,477 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_hau.yaml' 2026-09-01T00:16:52,478 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_ibo.yaml' 2026-09-01T00:16:52,479 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_kin.yaml' 2026-09-01T00:16:52,481 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_swa.yaml' 2026-09-01T00:16:52,482 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_twi.yaml' 2026-09-01T00:16:52,483 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_yor.yaml' 2026-09-01T00:16:52,484 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/afriqa_zul.yaml' 2026-09-01T00:16:52,486 adding 'lm_eval/tasks/afrobench/afriqa/prompt_2/utils.py' 2026-09-01T00:16:52,487 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa' 2026-09-01T00:16:52,489 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_bem.yaml' 2026-09-01T00:16:52,490 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_fon.yaml' 2026-09-01T00:16:52,491 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_hau.yaml' 2026-09-01T00:16:52,492 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_ibo.yaml' 2026-09-01T00:16:52,493 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_kin.yaml' 2026-09-01T00:16:52,494 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_swa.yaml' 2026-09-01T00:16:52,496 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_twi.yaml' 2026-09-01T00:16:52,497 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_yor.yaml' 2026-09-01T00:16:52,498 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/afriqa_zul.yaml' 2026-09-01T00:16:52,499 adding 'lm_eval/tasks/afrobench/afriqa/prompt_3/utils.py' 2026-09-01T00:16:52,500 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa' 2026-09-01T00:16:52,501 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_bem.yaml' 2026-09-01T00:16:52,503 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_fon.yaml' 2026-09-01T00:16:52,504 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_hau.yaml' 2026-09-01T00:16:52,505 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_ibo.yaml' 2026-09-01T00:16:52,506 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_kin.yaml' 2026-09-01T00:16:52,507 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_swa.yaml' 2026-09-01T00:16:52,508 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_twi.yaml' 2026-09-01T00:16:52,509 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_yor.yaml' 2026-09-01T00:16:52,510 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/afriqa_zul.yaml' 2026-09-01T00:16:52,512 adding 'lm_eval/tasks/afrobench/afriqa/prompt_4/utils.py' 2026-09-01T00:16:52,513 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa' 2026-09-01T00:16:52,514 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_bem.yaml' 2026-09-01T00:16:52,516 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_fon.yaml' 2026-09-01T00:16:52,517 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_hau.yaml' 2026-09-01T00:16:52,518 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_ibo.yaml' 2026-09-01T00:16:52,519 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_kin.yaml' 2026-09-01T00:16:52,520 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_swa.yaml' 2026-09-01T00:16:52,521 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_twi.yaml' 2026-09-01T00:16:52,522 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_yor.yaml' 2026-09-01T00:16:52,524 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/afriqa_zul.yaml' 2026-09-01T00:16:52,525 adding 'lm_eval/tasks/afrobench/afriqa/prompt_5/utils.py' 2026-09-01T00:16:52,527 adding 'lm_eval/tasks/afrobench/afrisenti/README.md' 2026-09-01T00:16:52,528 adding 'lm_eval/tasks/afrobench/afrisenti/afrisenti.yaml' 2026-09-01T00:16:52,529 adding 'lm_eval/tasks/afrobench/afrisenti/fewshot.sh' 2026-09-01T00:16:52,531 adding 'lm_eval/tasks/afrobench/afrisenti/utils.py' 2026-09-01T00:16:52,533 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti' 2026-09-01T00:16:52,534 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_amh.yaml' 2026-09-01T00:16:52,536 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_arq.yaml' 2026-09-01T00:16:52,537 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ary.yaml' 2026-09-01T00:16:52,539 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_hau.yaml' 2026-09-01T00:16:52,540 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_ibo.yaml' 2026-09-01T00:16:52,541 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_kin.yaml' 2026-09-01T00:16:52,542 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_orm.yaml' 2026-09-01T00:16:52,543 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_pcm.yaml' 2026-09-01T00:16:52,544 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_por.yaml' 2026-09-01T00:16:52,546 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_swa.yaml' 2026-09-01T00:16:52,547 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tir.yaml' 2026-09-01T00:16:52,548 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_tso.yaml' 2026-09-01T00:16:52,549 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_twi.yaml' 2026-09-01T00:16:52,550 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/afrisenti_yor.yaml' 2026-09-01T00:16:52,551 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/run.sh' 2026-09-01T00:16:52,552 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/utils.py' 2026-09-01T00:16:52,554 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_1/xx.py' 2026-09-01T00:16:52,556 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti' 2026-09-01T00:16:52,557 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_amh.yaml' 2026-09-01T00:16:52,558 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_arq.yaml' 2026-09-01T00:16:52,559 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ary.yaml' 2026-09-01T00:16:52,561 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_hau.yaml' 2026-09-01T00:16:52,562 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_ibo.yaml' 2026-09-01T00:16:52,563 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_kin.yaml' 2026-09-01T00:16:52,564 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_orm.yaml' 2026-09-01T00:16:52,565 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_pcm.yaml' 2026-09-01T00:16:52,567 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_por.yaml' 2026-09-01T00:16:52,568 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_swa.yaml' 2026-09-01T00:16:52,569 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tir.yaml' 2026-09-01T00:16:52,570 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_tso.yaml' 2026-09-01T00:16:52,571 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_twi.yaml' 2026-09-01T00:16:52,572 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/afrisenti_yor.yaml' 2026-09-01T00:16:52,573 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/run.sh' 2026-09-01T00:16:52,574 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/utils.py' 2026-09-01T00:16:52,576 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_2/xx.py' 2026-09-01T00:16:52,578 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti' 2026-09-01T00:16:52,579 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_amh.yaml' 2026-09-01T00:16:52,580 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_arq.yaml' 2026-09-01T00:16:52,581 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ary.yaml' 2026-09-01T00:16:52,582 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_hau.yaml' 2026-09-01T00:16:52,583 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_ibo.yaml' 2026-09-01T00:16:52,585 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_kin.yaml' 2026-09-01T00:16:52,586 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_orm.yaml' 2026-09-01T00:16:52,587 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_pcm.yaml' 2026-09-01T00:16:52,588 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_por.yaml' 2026-09-01T00:16:52,589 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_swa.yaml' 2026-09-01T00:16:52,591 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tir.yaml' 2026-09-01T00:16:52,592 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_tso.yaml' 2026-09-01T00:16:52,593 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_twi.yaml' 2026-09-01T00:16:52,594 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/afrisenti_yor.yaml' 2026-09-01T00:16:52,596 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/utils.py' 2026-09-01T00:16:52,597 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_3/xx.py' 2026-09-01T00:16:52,599 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti' 2026-09-01T00:16:52,600 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_amh.yaml' 2026-09-01T00:16:52,601 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_arq.yaml' 2026-09-01T00:16:52,602 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ary.yaml' 2026-09-01T00:16:52,604 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_hau.yaml' 2026-09-01T00:16:52,605 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_ibo.yaml' 2026-09-01T00:16:52,606 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_kin.yaml' 2026-09-01T00:16:52,607 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_orm.yaml' 2026-09-01T00:16:52,608 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_pcm.yaml' 2026-09-01T00:16:52,609 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_por.yaml' 2026-09-01T00:16:52,610 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_swa.yaml' 2026-09-01T00:16:52,612 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tir.yaml' 2026-09-01T00:16:52,613 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_tso.yaml' 2026-09-01T00:16:52,614 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_twi.yaml' 2026-09-01T00:16:52,615 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/afrisenti_yor.yaml' 2026-09-01T00:16:52,616 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/utils.py' 2026-09-01T00:16:52,617 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_4/xx.py' 2026-09-01T00:16:52,619 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti' 2026-09-01T00:16:52,620 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_amh.yaml' 2026-09-01T00:16:52,622 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_arq.yaml' 2026-09-01T00:16:52,623 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ary.yaml' 2026-09-01T00:16:52,624 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_hau.yaml' 2026-09-01T00:16:52,625 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_ibo.yaml' 2026-09-01T00:16:52,626 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_kin.yaml' 2026-09-01T00:16:52,627 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_orm.yaml' 2026-09-01T00:16:52,629 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_pcm.yaml' 2026-09-01T00:16:52,630 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_por.yaml' 2026-09-01T00:16:52,631 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_swa.yaml' 2026-09-01T00:16:52,632 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tir.yaml' 2026-09-01T00:16:52,634 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_tso.yaml' 2026-09-01T00:16:52,635 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_twi.yaml' 2026-09-01T00:16:52,636 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/afrisenti_yor.yaml' 2026-09-01T00:16:52,637 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/utils.py' 2026-09-01T00:16:52,638 adding 'lm_eval/tasks/afrobench/afrisenti/prompt_5/xx.py' 2026-09-01T00:16:52,641 adding 'lm_eval/tasks/afrobench/belebele/README.md' 2026-09-01T00:16:52,642 adding 'lm_eval/tasks/afrobench/belebele/belebele.yaml' 2026-09-01T00:16:52,643 adding 'lm_eval/tasks/afrobench/belebele/utils.py' 2026-09-01T00:16:52,646 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele' 2026-09-01T00:16:52,647 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_afr.yaml' 2026-09-01T00:16:52,648 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_amh.yaml' 2026-09-01T00:16:52,650 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ary.yaml' 2026-09-01T00:16:52,651 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_arz.yaml' 2026-09-01T00:16:52,652 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_bam.yaml' 2026-09-01T00:16:52,653 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_eng.yaml' 2026-09-01T00:16:52,654 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fra.yaml' 2026-09-01T00:16:52,656 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_fuv.yaml' 2026-09-01T00:16:52,657 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_gaz.yaml' 2026-09-01T00:16:52,658 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_hau.yaml' 2026-09-01T00:16:52,659 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ibo.yaml' 2026-09-01T00:16:52,660 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kea.yaml' 2026-09-01T00:16:52,661 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_kin.yaml' 2026-09-01T00:16:52,663 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lin.yaml' 2026-09-01T00:16:52,664 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_lug.yaml' 2026-09-01T00:16:52,665 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_luo.yaml' 2026-09-01T00:16:52,666 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_nya.yaml' 2026-09-01T00:16:52,667 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_plt.yaml' 2026-09-01T00:16:52,668 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_por.yaml' 2026-09-01T00:16:52,669 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sna.yaml' 2026-09-01T00:16:52,671 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_som.yaml' 2026-09-01T00:16:52,672 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_sot.yaml' 2026-09-01T00:16:52,673 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_ssw.yaml' 2026-09-01T00:16:52,674 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_swa.yaml' 2026-09-01T00:16:52,675 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tir.yaml' 2026-09-01T00:16:52,676 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tsn.yaml' 2026-09-01T00:16:52,678 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_tso.yaml' 2026-09-01T00:16:52,679 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_wol.yaml' 2026-09-01T00:16:52,680 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_xho.yaml' 2026-09-01T00:16:52,681 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_yor.yaml' 2026-09-01T00:16:52,682 adding 'lm_eval/tasks/afrobench/belebele/prompt_1/belebele_zul.yaml' 2026-09-01T00:16:52,685 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele' 2026-09-01T00:16:52,686 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_afr.yaml' 2026-09-01T00:16:52,687 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_amh.yaml' 2026-09-01T00:16:52,688 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ary.yaml' 2026-09-01T00:16:52,689 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_arz.yaml' 2026-09-01T00:16:52,690 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_bam.yaml' 2026-09-01T00:16:52,691 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_eng.yaml' 2026-09-01T00:16:52,693 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fra.yaml' 2026-09-01T00:16:52,694 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_fuv.yaml' 2026-09-01T00:16:52,695 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_gaz.yaml' 2026-09-01T00:16:52,696 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_hau.yaml' 2026-09-01T00:16:52,697 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ibo.yaml' 2026-09-01T00:16:52,699 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kea.yaml' 2026-09-01T00:16:52,700 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_kin.yaml' 2026-09-01T00:16:52,701 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lin.yaml' 2026-09-01T00:16:52,702 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_lug.yaml' 2026-09-01T00:16:52,703 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_luo.yaml' 2026-09-01T00:16:52,704 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_nya.yaml' 2026-09-01T00:16:52,706 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_plt.yaml' 2026-09-01T00:16:52,707 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_por.yaml' 2026-09-01T00:16:52,708 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sna.yaml' 2026-09-01T00:16:52,709 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_som.yaml' 2026-09-01T00:16:52,711 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_sot.yaml' 2026-09-01T00:16:52,712 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_ssw.yaml' 2026-09-01T00:16:52,713 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_swa.yaml' 2026-09-01T00:16:52,714 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tir.yaml' 2026-09-01T00:16:52,715 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tsn.yaml' 2026-09-01T00:16:52,716 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_tso.yaml' 2026-09-01T00:16:52,717 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_wol.yaml' 2026-09-01T00:16:52,718 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_xho.yaml' 2026-09-01T00:16:52,719 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_yor.yaml' 2026-09-01T00:16:52,721 adding 'lm_eval/tasks/afrobench/belebele/prompt_2/belebele_zul.yaml' 2026-09-01T00:16:52,723 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele' 2026-09-01T00:16:52,724 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_afr.yaml' 2026-09-01T00:16:52,725 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_amh.yaml' 2026-09-01T00:16:52,726 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ary.yaml' 2026-09-01T00:16:52,728 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_arz.yaml' 2026-09-01T00:16:52,729 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_bam.yaml' 2026-09-01T00:16:52,730 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_eng.yaml' 2026-09-01T00:16:52,731 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fra.yaml' 2026-09-01T00:16:52,732 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_fuv.yaml' 2026-09-01T00:16:52,733 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_gaz.yaml' 2026-09-01T00:16:52,734 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_hau.yaml' 2026-09-01T00:16:52,735 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ibo.yaml' 2026-09-01T00:16:52,737 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kea.yaml' 2026-09-01T00:16:52,738 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_kin.yaml' 2026-09-01T00:16:52,739 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lin.yaml' 2026-09-01T00:16:52,740 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_lug.yaml' 2026-09-01T00:16:52,741 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_luo.yaml' 2026-09-01T00:16:52,742 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_nya.yaml' 2026-09-01T00:16:52,744 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_plt.yaml' 2026-09-01T00:16:52,745 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_por.yaml' 2026-09-01T00:16:52,746 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sna.yaml' 2026-09-01T00:16:52,747 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_som.yaml' 2026-09-01T00:16:52,748 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_sot.yaml' 2026-09-01T00:16:52,750 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_ssw.yaml' 2026-09-01T00:16:52,751 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_swa.yaml' 2026-09-01T00:16:52,752 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tir.yaml' 2026-09-01T00:16:52,753 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tsn.yaml' 2026-09-01T00:16:52,754 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_tso.yaml' 2026-09-01T00:16:52,756 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_wol.yaml' 2026-09-01T00:16:52,757 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_xho.yaml' 2026-09-01T00:16:52,758 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_yor.yaml' 2026-09-01T00:16:52,759 adding 'lm_eval/tasks/afrobench/belebele/prompt_3/belebele_zul.yaml' 2026-09-01T00:16:52,761 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele' 2026-09-01T00:16:52,762 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_afr.yaml' 2026-09-01T00:16:52,764 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_amh.yaml' 2026-09-01T00:16:52,765 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ary.yaml' 2026-09-01T00:16:52,766 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_arz.yaml' 2026-09-01T00:16:52,767 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_bam.yaml' 2026-09-01T00:16:52,768 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_eng.yaml' 2026-09-01T00:16:52,769 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fra.yaml' 2026-09-01T00:16:52,770 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_fuv.yaml' 2026-09-01T00:16:52,771 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_gaz.yaml' 2026-09-01T00:16:52,772 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_hau.yaml' 2026-09-01T00:16:52,773 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ibo.yaml' 2026-09-01T00:16:52,774 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kea.yaml' 2026-09-01T00:16:52,776 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_kin.yaml' 2026-09-01T00:16:52,777 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lin.yaml' 2026-09-01T00:16:52,778 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_lug.yaml' 2026-09-01T00:16:52,779 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_luo.yaml' 2026-09-01T00:16:52,780 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_nya.yaml' 2026-09-01T00:16:52,781 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_plt.yaml' 2026-09-01T00:16:52,782 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_por.yaml' 2026-09-01T00:16:52,784 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sna.yaml' 2026-09-01T00:16:52,785 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_som.yaml' 2026-09-01T00:16:52,786 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_sot.yaml' 2026-09-01T00:16:52,787 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_ssw.yaml' 2026-09-01T00:16:52,788 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_swa.yaml' 2026-09-01T00:16:52,789 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tir.yaml' 2026-09-01T00:16:52,791 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tsn.yaml' 2026-09-01T00:16:52,792 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_tso.yaml' 2026-09-01T00:16:52,793 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_wol.yaml' 2026-09-01T00:16:52,794 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_xho.yaml' 2026-09-01T00:16:52,795 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_yor.yaml' 2026-09-01T00:16:52,796 adding 'lm_eval/tasks/afrobench/belebele/prompt_4/belebele_zul.yaml' 2026-09-01T00:16:52,799 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele' 2026-09-01T00:16:52,800 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_afr.yaml' 2026-09-01T00:16:52,801 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_amh.yaml' 2026-09-01T00:16:52,802 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ary.yaml' 2026-09-01T00:16:52,803 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_arz.yaml' 2026-09-01T00:16:52,805 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_bam.yaml' 2026-09-01T00:16:52,806 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_eng.yaml' 2026-09-01T00:16:52,807 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fra.yaml' 2026-09-01T00:16:52,808 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_fuv.yaml' 2026-09-01T00:16:52,810 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_gaz.yaml' 2026-09-01T00:16:52,811 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_hau.yaml' 2026-09-01T00:16:52,812 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ibo.yaml' 2026-09-01T00:16:52,813 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kea.yaml' 2026-09-01T00:16:52,814 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_kin.yaml' 2026-09-01T00:16:52,815 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lin.yaml' 2026-09-01T00:16:52,817 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_lug.yaml' 2026-09-01T00:16:52,818 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_luo.yaml' 2026-09-01T00:16:52,819 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_nya.yaml' 2026-09-01T00:16:52,820 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_plt.yaml' 2026-09-01T00:16:52,821 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_por.yaml' 2026-09-01T00:16:52,822 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sna.yaml' 2026-09-01T00:16:52,824 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_som.yaml' 2026-09-01T00:16:52,825 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_sot.yaml' 2026-09-01T00:16:52,826 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_ssw.yaml' 2026-09-01T00:16:52,827 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_swa.yaml' 2026-09-01T00:16:52,829 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tir.yaml' 2026-09-01T00:16:52,830 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tsn.yaml' 2026-09-01T00:16:52,831 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_tso.yaml' 2026-09-01T00:16:52,832 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_wol.yaml' 2026-09-01T00:16:52,833 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_xho.yaml' 2026-09-01T00:16:52,835 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_yor.yaml' 2026-09-01T00:16:52,836 adding 'lm_eval/tasks/afrobench/belebele/prompt_5/belebele_zul.yaml' 2026-09-01T00:16:52,838 adding 'lm_eval/tasks/afrobench/flores/README.md' 2026-09-01T00:16:52,839 adding 'lm_eval/tasks/afrobench/flores/flores.yaml' 2026-09-01T00:16:52,840 adding 'lm_eval/tasks/afrobench/flores/gen_utils.py' 2026-09-01T00:16:52,842 adding 'lm_eval/tasks/afrobench/flores/prompt_1/flores' 2026-09-01T00:16:52,845 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores' 2026-09-01T00:16:52,846 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,847 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,848 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,850 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,851 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,852 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,853 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:16:52,854 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,855 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,857 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,858 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,859 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,860 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,861 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,862 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,864 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,865 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,866 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,867 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,868 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,869 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,870 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,871 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,872 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,873 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,875 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,876 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,877 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,878 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,879 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,880 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,881 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,882 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,883 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,884 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,886 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,887 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,888 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,889 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,890 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,891 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,892 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_run_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,894 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,895 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,896 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_som_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,897 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,898 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,899 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,901 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,902 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,903 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-09-01T00:16:52,904 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:16:52,905 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,906 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,907 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,908 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,909 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-09-01T00:16:52,911 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,912 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,913 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,914 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,915 adding 'lm_eval/tasks/afrobench/flores/prompt_1/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-09-01T00:16:52,918 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores' 2026-09-01T00:16:52,919 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-09-01T00:16:52,921 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-09-01T00:16:52,922 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-09-01T00:16:52,923 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-09-01T00:16:52,924 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-09-01T00:16:52,925 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-09-01T00:16:52,926 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:16:52,928 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-09-01T00:16:52,929 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-09-01T00:16:52,930 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-09-01T00:16:52,931 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-09-01T00:16:52,932 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-09-01T00:16:52,933 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-09-01T00:16:52,934 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-09-01T00:16:52,936 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-09-01T00:16:52,937 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:16:52,938 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-09-01T00:16:52,939 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-09-01T00:16:52,941 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-09-01T00:16:52,942 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-09-01T00:16:52,943 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-09-01T00:16:52,944 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:16:52,946 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-09-01T00:16:52,947 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-09-01T00:16:52,948 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-09-01T00:16:52,950 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-09-01T00:16:52,951 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-09-01T00:16:52,952 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-09-01T00:16:52,954 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-09-01T00:16:52,955 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-09-01T00:16:52,957 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-09-01T00:16:52,958 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-09-01T00:16:52,959 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-09-01T00:16:52,960 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-09-01T00:16:52,961 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-09-01T00:16:52,962 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-09-01T00:16:52,963 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-09-01T00:16:52,965 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-09-01T00:16:52,966 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-09-01T00:16:52,967 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-09-01T00:16:52,968 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-09-01T00:16:52,969 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-run_Latn.yaml' 2026-09-01T00:16:52,970 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-09-01T00:16:52,972 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-09-01T00:16:52,973 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-som_Latn.yaml' 2026-09-01T00:16:52,974 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-09-01T00:16:52,975 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:16:52,976 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-09-01T00:16:52,978 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-09-01T00:16:52,979 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-09-01T00:16:52,980 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-09-01T00:16:52,981 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:16:52,982 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:16:52,983 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-09-01T00:16:52,985 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-09-01T00:16:52,986 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-09-01T00:16:52,987 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-09-01T00:16:52,988 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-09-01T00:16:52,989 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-09-01T00:16:52,990 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-09-01T00:16:52,991 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-09-01T00:16:52,993 adding 'lm_eval/tasks/afrobench/flores/prompt_1/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-09-01T00:16:52,994 adding 'lm_eval/tasks/afrobench/flores/prompt_2/flores' 2026-09-01T00:16:52,997 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores' 2026-09-01T00:16:52,998 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-09-01T00:16:52,999 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,000 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,001 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,002 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,004 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,005 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:16:53,006 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,007 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,008 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,010 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,011 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,012 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,013 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,014 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,016 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,017 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,018 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,019 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,021 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,022 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,023 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,024 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,025 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,027 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,028 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,029 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,030 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,031 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,032 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,033 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,035 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,036 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,037 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,038 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,039 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,040 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,042 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,043 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,044 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,045 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,046 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_run_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,048 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,049 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,050 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_som_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,051 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,052 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,053 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,054 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,056 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,057 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-09-01T00:16:53,058 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:16:53,059 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,060 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,062 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,063 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,064 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-09-01T00:16:53,065 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,066 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,067 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,068 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,069 adding 'lm_eval/tasks/afrobench/flores/prompt_2/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,072 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores' 2026-09-01T00:16:53,073 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-09-01T00:16:53,074 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-09-01T00:16:53,075 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-09-01T00:16:53,076 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-09-01T00:16:53,078 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-09-01T00:16:53,079 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-09-01T00:16:53,080 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:16:53,081 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-09-01T00:16:53,082 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-09-01T00:16:53,083 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-09-01T00:16:53,084 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-09-01T00:16:53,085 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-09-01T00:16:53,087 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-09-01T00:16:53,088 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-09-01T00:16:53,089 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-09-01T00:16:53,090 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:16:53,091 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-09-01T00:16:53,092 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-09-01T00:16:53,094 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-09-01T00:16:53,095 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-09-01T00:16:53,096 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-09-01T00:16:53,097 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:16:53,098 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-09-01T00:16:53,099 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-09-01T00:16:53,101 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-09-01T00:16:53,102 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-09-01T00:16:53,103 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-09-01T00:16:53,104 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-09-01T00:16:53,105 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-09-01T00:16:53,107 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-09-01T00:16:53,108 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-09-01T00:16:53,109 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-09-01T00:16:53,110 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-09-01T00:16:53,111 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-09-01T00:16:53,112 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-09-01T00:16:53,113 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-09-01T00:16:53,114 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-09-01T00:16:53,116 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-09-01T00:16:53,117 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-09-01T00:16:53,118 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-09-01T00:16:53,119 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-09-01T00:16:53,120 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-run_Latn.yaml' 2026-09-01T00:16:53,121 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-09-01T00:16:53,122 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-09-01T00:16:53,123 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-som_Latn.yaml' 2026-09-01T00:16:53,124 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-09-01T00:16:53,126 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:16:53,127 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-09-01T00:16:53,128 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-09-01T00:16:53,129 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-09-01T00:16:53,130 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-09-01T00:16:53,131 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:16:53,133 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:16:53,134 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-09-01T00:16:53,135 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-09-01T00:16:53,136 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-09-01T00:16:53,137 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-09-01T00:16:53,139 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-09-01T00:16:53,140 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-09-01T00:16:53,141 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-09-01T00:16:53,142 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-09-01T00:16:53,143 adding 'lm_eval/tasks/afrobench/flores/prompt_2/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-09-01T00:16:53,145 adding 'lm_eval/tasks/afrobench/flores/prompt_3/flores' 2026-09-01T00:16:53,148 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores' 2026-09-01T00:16:53,149 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,150 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ace_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,151 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_acq_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,152 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aeb_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,153 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_afr_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,154 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_aka_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,155 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:16:53,156 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ary_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,157 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_arz_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,158 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bam_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,159 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ban_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,161 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_bem_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,162 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_cjk_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,163 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dik_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,164 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_dyu_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,165 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,166 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fon_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,167 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fra_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,169 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_fuv_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,170 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_gaz_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,171 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_hau_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,172 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,173 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kab_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,174 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kam_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,176 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kbp_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,177 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kea_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,178 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kik_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,179 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kin_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,181 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kmb_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,182 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Arab-eng_Latn.yaml' 2026-09-01T00:16:53,183 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_knc_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,184 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_kon_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,185 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lin_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,187 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lua_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,188 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_lug_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,189 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_luo_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,190 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_mos_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,191 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nso_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,192 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nus_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,193 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_nya_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,194 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_plt_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,196 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_run_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,197 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sag_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,198 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sna_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,199 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_som_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,200 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sot_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,201 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,202 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_sun_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,204 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_swh_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,205 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,206 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_taq_Tfng-eng_Latn.yaml' 2026-09-01T00:16:53,207 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:16:53,209 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,210 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tso_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,211 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tum_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,212 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_twi_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,214 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_tzm_Tfng-eng_Latn.yaml' 2026-09-01T00:16:53,215 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_umb_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,217 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_wol_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,218 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_xho_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,219 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_yor_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,220 adding 'lm_eval/tasks/afrobench/flores/prompt_3/african-english/flores_zul_Latn-eng_Latn.yaml' 2026-09-01T00:16:53,223 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores' 2026-09-01T00:16:53,224 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Arab.yaml' 2026-09-01T00:16:53,226 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ace_Latn.yaml' 2026-09-01T00:16:53,227 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-acq_Arab.yaml' 2026-09-01T00:16:53,228 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aeb_Arab.yaml' 2026-09-01T00:16:53,229 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-afr_Latn.yaml' 2026-09-01T00:16:53,230 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-aka_Latn.yaml' 2026-09-01T00:16:53,231 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:16:53,232 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ary_Arab.yaml' 2026-09-01T00:16:53,234 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-arz_Arab.yaml' 2026-09-01T00:16:53,235 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bam_Latn.yaml' 2026-09-01T00:16:53,236 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ban_Latn.yaml' 2026-09-01T00:16:53,237 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-bem_Latn.yaml' 2026-09-01T00:16:53,238 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-cjk_Latn.yaml' 2026-09-01T00:16:53,239 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dik_Latn.yaml' 2026-09-01T00:16:53,241 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-dyu_Latn.yaml' 2026-09-01T00:16:53,242 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:16:53,243 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fon_Latn.yaml' 2026-09-01T00:16:53,244 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fra_Latn.yaml' 2026-09-01T00:16:53,245 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-fuv_Latn.yaml' 2026-09-01T00:16:53,247 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-gaz_Latn.yaml' 2026-09-01T00:16:53,248 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-hau_Latn.yaml' 2026-09-01T00:16:53,249 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:16:53,251 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kab_Latn.yaml' 2026-09-01T00:16:53,252 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kam_Latn.yaml' 2026-09-01T00:16:53,253 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kbp_Latn.yaml' 2026-09-01T00:16:53,254 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kea_Latn.yaml' 2026-09-01T00:16:53,256 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kik_Latn.yaml' 2026-09-01T00:16:53,257 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kin_Latn.yaml' 2026-09-01T00:16:53,259 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kmb_Latn.yaml' 2026-09-01T00:16:53,260 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Arab.yaml' 2026-09-01T00:16:53,261 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-knc_Latn.yaml' 2026-09-01T00:16:53,262 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-kon_Latn.yaml' 2026-09-01T00:16:53,263 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lin_Latn.yaml' 2026-09-01T00:16:53,265 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lua_Latn.yaml' 2026-09-01T00:16:53,266 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-lug_Latn.yaml' 2026-09-01T00:16:53,267 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-luo_Latn.yaml' 2026-09-01T00:16:53,268 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-mos_Latn.yaml' 2026-09-01T00:16:53,269 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nso_Latn.yaml' 2026-09-01T00:16:53,271 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nus_Latn.yaml' 2026-09-01T00:16:53,272 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-nya_Latn.yaml' 2026-09-01T00:16:53,273 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-plt_Latn.yaml' 2026-09-01T00:16:53,274 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-run_Latn.yaml' 2026-09-01T00:16:53,275 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sag_Latn.yaml' 2026-09-01T00:16:53,276 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sna_Latn.yaml' 2026-09-01T00:16:53,277 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-som_Latn.yaml' 2026-09-01T00:16:53,278 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sot_Latn.yaml' 2026-09-01T00:16:53,280 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:16:53,281 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-sun_Latn.yaml' 2026-09-01T00:16:53,282 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-swh_Latn.yaml' 2026-09-01T00:16:53,283 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Latn.yaml' 2026-09-01T00:16:53,284 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-taq_Tfng.yaml' 2026-09-01T00:16:53,285 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:16:53,286 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:16:53,288 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tso_Latn.yaml' 2026-09-01T00:16:53,289 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tum_Latn.yaml' 2026-09-01T00:16:53,290 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-twi_Latn.yaml' 2026-09-01T00:16:53,291 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-tzm_Tfng.yaml' 2026-09-01T00:16:53,293 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-umb_Latn.yaml' 2026-09-01T00:16:53,294 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-wol_Latn.yaml' 2026-09-01T00:16:53,295 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-xho_Latn.yaml' 2026-09-01T00:16:53,296 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-yor_Latn.yaml' 2026-09-01T00:16:53,298 adding 'lm_eval/tasks/afrobench/flores/prompt_3/english-african/flores_eng_Latn-zul_Latn.yaml' 2026-09-01T00:16:53,300 adding 'lm_eval/tasks/afrobench/injongointent/README.md' 2026-09-01T00:16:53,302 adding 'lm_eval/tasks/afrobench/injongointent/gen_utils.py' 2026-09-01T00:16:53,303 adding 'lm_eval/tasks/afrobench/injongointent/injongointent.yaml' 2026-09-01T00:16:53,305 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent' 2026-09-01T00:16:53,306 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_amh.yaml' 2026-09-01T00:16:53,308 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_eng.yaml' 2026-09-01T00:16:53,309 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ewe.yaml' 2026-09-01T00:16:53,310 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_hau.yaml' 2026-09-01T00:16:53,311 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_ibo.yaml' 2026-09-01T00:16:53,313 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_kin.yaml' 2026-09-01T00:16:53,314 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lin.yaml' 2026-09-01T00:16:53,315 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_lug.yaml' 2026-09-01T00:16:53,316 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_orm.yaml' 2026-09-01T00:16:53,317 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sna.yaml' 2026-09-01T00:16:53,319 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_sot.yaml' 2026-09-01T00:16:53,320 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_swa.yaml' 2026-09-01T00:16:53,321 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_twi.yaml' 2026-09-01T00:16:53,322 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_wol.yaml' 2026-09-01T00:16:53,323 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_xho.yaml' 2026-09-01T00:16:53,324 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_yor.yaml' 2026-09-01T00:16:53,326 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/injongointent_zul.yaml' 2026-09-01T00:16:53,327 adding 'lm_eval/tasks/afrobench/injongointent/prompt_1/utils.py' 2026-09-01T00:16:53,329 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent' 2026-09-01T00:16:53,330 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_amh.yaml' 2026-09-01T00:16:53,331 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_eng.yaml' 2026-09-01T00:16:53,332 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ewe.yaml' 2026-09-01T00:16:53,333 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_hau.yaml' 2026-09-01T00:16:53,335 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_ibo.yaml' 2026-09-01T00:16:53,336 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_kin.yaml' 2026-09-01T00:16:53,337 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lin.yaml' 2026-09-01T00:16:53,338 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_lug.yaml' 2026-09-01T00:16:53,339 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_orm.yaml' 2026-09-01T00:16:53,341 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sna.yaml' 2026-09-01T00:16:53,342 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_sot.yaml' 2026-09-01T00:16:53,343 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_swa.yaml' 2026-09-01T00:16:53,344 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_twi.yaml' 2026-09-01T00:16:53,346 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_wol.yaml' 2026-09-01T00:16:53,347 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_xho.yaml' 2026-09-01T00:16:53,348 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_yor.yaml' 2026-09-01T00:16:53,349 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/injongointent_zul.yaml' 2026-09-01T00:16:53,350 adding 'lm_eval/tasks/afrobench/injongointent/prompt_2/utils.py' 2026-09-01T00:16:53,352 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent' 2026-09-01T00:16:53,354 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_amh.yaml' 2026-09-01T00:16:53,355 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_eng.yaml' 2026-09-01T00:16:53,356 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ewe.yaml' 2026-09-01T00:16:53,358 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_hau.yaml' 2026-09-01T00:16:53,359 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_ibo.yaml' 2026-09-01T00:16:53,360 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_kin.yaml' 2026-09-01T00:16:53,361 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lin.yaml' 2026-09-01T00:16:53,363 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_lug.yaml' 2026-09-01T00:16:53,364 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_orm.yaml' 2026-09-01T00:16:53,365 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sna.yaml' 2026-09-01T00:16:53,366 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_sot.yaml' 2026-09-01T00:16:53,368 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_swa.yaml' 2026-09-01T00:16:53,369 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_twi.yaml' 2026-09-01T00:16:53,370 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_wol.yaml' 2026-09-01T00:16:53,371 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_xho.yaml' 2026-09-01T00:16:53,372 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_yor.yaml' 2026-09-01T00:16:53,373 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/injongointent_zul.yaml' 2026-09-01T00:16:53,374 adding 'lm_eval/tasks/afrobench/injongointent/prompt_3/utils.py' 2026-09-01T00:16:53,376 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent' 2026-09-01T00:16:53,377 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_amh.yaml' 2026-09-01T00:16:53,379 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_eng.yaml' 2026-09-01T00:16:53,380 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ewe.yaml' 2026-09-01T00:16:53,381 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_hau.yaml' 2026-09-01T00:16:53,383 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_ibo.yaml' 2026-09-01T00:16:53,384 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_kin.yaml' 2026-09-01T00:16:53,385 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lin.yaml' 2026-09-01T00:16:53,386 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_lug.yaml' 2026-09-01T00:16:53,387 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_orm.yaml' 2026-09-01T00:16:53,389 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sna.yaml' 2026-09-01T00:16:53,390 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_sot.yaml' 2026-09-01T00:16:53,391 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_swa.yaml' 2026-09-01T00:16:53,393 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_twi.yaml' 2026-09-01T00:16:53,394 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_wol.yaml' 2026-09-01T00:16:53,395 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_xho.yaml' 2026-09-01T00:16:53,397 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_yor.yaml' 2026-09-01T00:16:53,398 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/injongointent_zul.yaml' 2026-09-01T00:16:53,399 adding 'lm_eval/tasks/afrobench/injongointent/prompt_4/utils.py' 2026-09-01T00:16:53,401 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent' 2026-09-01T00:16:53,402 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_amh.yaml' 2026-09-01T00:16:53,403 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_eng.yaml' 2026-09-01T00:16:53,405 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ewe.yaml' 2026-09-01T00:16:53,406 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_hau.yaml' 2026-09-01T00:16:53,407 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_ibo.yaml' 2026-09-01T00:16:53,408 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_kin.yaml' 2026-09-01T00:16:53,410 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lin.yaml' 2026-09-01T00:16:53,411 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_lug.yaml' 2026-09-01T00:16:53,412 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_orm.yaml' 2026-09-01T00:16:53,414 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sna.yaml' 2026-09-01T00:16:53,415 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_sot.yaml' 2026-09-01T00:16:53,417 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_swa.yaml' 2026-09-01T00:16:53,420 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_twi.yaml' 2026-09-01T00:16:53,424 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_wol.yaml' 2026-09-01T00:16:53,429 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_xho.yaml' 2026-09-01T00:16:53,434 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_yor.yaml' 2026-09-01T00:16:53,435 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/injongointent_zul.yaml' 2026-09-01T00:16:53,436 adding 'lm_eval/tasks/afrobench/injongointent/prompt_5/utils.py' 2026-09-01T00:16:53,438 adding 'lm_eval/tasks/afrobench/mafand/README.md' 2026-09-01T00:16:53,439 adding 'lm_eval/tasks/afrobench/mafand/gen_utils.py' 2026-09-01T00:16:53,441 adding 'lm_eval/tasks/afrobench/mafand/mafand.yaml' 2026-09-01T00:16:53,443 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand' 2026-09-01T00:16:53,444 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_amh-en.yaml' 2026-09-01T00:16:53,445 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bam-fr.yaml' 2026-09-01T00:16:53,446 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_bbj-fr.yaml' 2026-09-01T00:16:53,448 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ewe-fr.yaml' 2026-09-01T00:16:53,449 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_fon-fr.yaml' 2026-09-01T00:16:53,450 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_hau-en.yaml' 2026-09-01T00:16:53,451 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_ibo-en.yaml' 2026-09-01T00:16:53,452 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_kin-en.yaml' 2026-09-01T00:16:53,453 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_lug-en.yaml' 2026-09-01T00:16:53,454 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_luo-en.yaml' 2026-09-01T00:16:53,455 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_mos-fr.yaml' 2026-09-01T00:16:53,456 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_nya-en.yaml' 2026-09-01T00:16:53,457 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_pcm-en.yaml' 2026-09-01T00:16:53,459 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_sna-en.yaml' 2026-09-01T00:16:53,460 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_swa-en.yaml' 2026-09-01T00:16:53,461 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_tsn-en.yaml' 2026-09-01T00:16:53,462 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_twi-en.yaml' 2026-09-01T00:16:53,463 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_wol-fr.yaml' 2026-09-01T00:16:53,464 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_xho-en.yaml' 2026-09-01T00:16:53,465 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_yor-en.yaml' 2026-09-01T00:16:53,467 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/mafand_zul-en.yaml' 2026-09-01T00:16:53,468 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/african-english/utils.py' 2026-09-01T00:16:53,470 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand' 2026-09-01T00:16:53,471 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-amh.yaml' 2026-09-01T00:16:53,472 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-hau.yaml' 2026-09-01T00:16:53,474 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-ibo.yaml' 2026-09-01T00:16:53,475 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-kin.yaml' 2026-09-01T00:16:53,476 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-lug.yaml' 2026-09-01T00:16:53,477 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-luo.yaml' 2026-09-01T00:16:53,478 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-nya.yaml' 2026-09-01T00:16:53,479 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-pcm.yaml' 2026-09-01T00:16:53,480 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-sna.yaml' 2026-09-01T00:16:53,481 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-swa.yaml' 2026-09-01T00:16:53,482 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-tsn.yaml' 2026-09-01T00:16:53,483 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-twi.yaml' 2026-09-01T00:16:53,484 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-xho.yaml' 2026-09-01T00:16:53,486 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-yor.yaml' 2026-09-01T00:16:53,487 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_en-zul.yaml' 2026-09-01T00:16:53,488 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bam.yaml' 2026-09-01T00:16:53,489 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-bbj.yaml' 2026-09-01T00:16:53,490 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-ewe.yaml' 2026-09-01T00:16:53,491 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-fon.yaml' 2026-09-01T00:16:53,492 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-mos.yaml' 2026-09-01T00:16:53,494 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/mafand_fr-wol.yaml' 2026-09-01T00:16:53,495 adding 'lm_eval/tasks/afrobench/mafand/prompt_1/english-african/utils.py' 2026-09-01T00:16:53,497 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand' 2026-09-01T00:16:53,499 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_amh-en.yaml' 2026-09-01T00:16:53,500 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bam-fr.yaml' 2026-09-01T00:16:53,501 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_bbj-fr.yaml' 2026-09-01T00:16:53,502 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ewe-fr.yaml' 2026-09-01T00:16:53,503 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_fon-fr.yaml' 2026-09-01T00:16:53,504 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_hau-en.yaml' 2026-09-01T00:16:53,506 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_ibo-en.yaml' 2026-09-01T00:16:53,507 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_kin-en.yaml' 2026-09-01T00:16:53,508 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_lug-en.yaml' 2026-09-01T00:16:53,509 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_luo-en.yaml' 2026-09-01T00:16:53,510 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_mos-fr.yaml' 2026-09-01T00:16:53,511 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_nya-en.yaml' 2026-09-01T00:16:53,512 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_pcm-en.yaml' 2026-09-01T00:16:53,513 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_sna-en.yaml' 2026-09-01T00:16:53,515 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_swa-en.yaml' 2026-09-01T00:16:53,516 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_tsn-en.yaml' 2026-09-01T00:16:53,517 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_twi-en.yaml' 2026-09-01T00:16:53,518 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_wol-fr.yaml' 2026-09-01T00:16:53,519 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_xho-en.yaml' 2026-09-01T00:16:53,520 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_yor-en.yaml' 2026-09-01T00:16:53,521 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/mafand_zul-en.yaml' 2026-09-01T00:16:53,523 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/african-english/utils.py' 2026-09-01T00:16:53,525 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand' 2026-09-01T00:16:53,526 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-amh.yaml' 2026-09-01T00:16:53,527 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-hau.yaml' 2026-09-01T00:16:53,528 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-ibo.yaml' 2026-09-01T00:16:53,529 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-kin.yaml' 2026-09-01T00:16:53,530 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-lug.yaml' 2026-09-01T00:16:53,531 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-luo.yaml' 2026-09-01T00:16:53,532 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-nya.yaml' 2026-09-01T00:16:53,533 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-pcm.yaml' 2026-09-01T00:16:53,535 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-sna.yaml' 2026-09-01T00:16:53,536 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-swa.yaml' 2026-09-01T00:16:53,537 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-tsn.yaml' 2026-09-01T00:16:53,538 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-twi.yaml' 2026-09-01T00:16:53,539 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-xho.yaml' 2026-09-01T00:16:53,540 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-yor.yaml' 2026-09-01T00:16:53,541 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_en-zul.yaml' 2026-09-01T00:16:53,542 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bam.yaml' 2026-09-01T00:16:53,543 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-bbj.yaml' 2026-09-01T00:16:53,545 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-ewe.yaml' 2026-09-01T00:16:53,546 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-fon.yaml' 2026-09-01T00:16:53,547 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-mos.yaml' 2026-09-01T00:16:53,548 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/mafand_fr-wol.yaml' 2026-09-01T00:16:53,549 adding 'lm_eval/tasks/afrobench/mafand/prompt_2/english-african/utils.py' 2026-09-01T00:16:53,552 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand' 2026-09-01T00:16:53,553 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_amh-en.yaml' 2026-09-01T00:16:53,554 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bam-fr.yaml' 2026-09-01T00:16:53,556 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_bbj-fr.yaml' 2026-09-01T00:16:53,557 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ewe-fr.yaml' 2026-09-01T00:16:53,558 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_fon-fr.yaml' 2026-09-01T00:16:53,559 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_hau-en.yaml' 2026-09-01T00:16:53,560 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_ibo-en.yaml' 2026-09-01T00:16:53,561 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_kin-en.yaml' 2026-09-01T00:16:53,563 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_lug-en.yaml' 2026-09-01T00:16:53,564 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_luo-en.yaml' 2026-09-01T00:16:53,565 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_mos-fr.yaml' 2026-09-01T00:16:53,566 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_nya-en.yaml' 2026-09-01T00:16:53,567 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_pcm-en.yaml' 2026-09-01T00:16:53,568 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_sna-en.yaml' 2026-09-01T00:16:53,569 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_swa-en.yaml' 2026-09-01T00:16:53,570 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_tsn-en.yaml' 2026-09-01T00:16:53,571 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_twi-en.yaml' 2026-09-01T00:16:53,572 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_wol-fr.yaml' 2026-09-01T00:16:53,573 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_xho-en.yaml' 2026-09-01T00:16:53,574 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_yor-en.yaml' 2026-09-01T00:16:53,576 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/mafand_zul-en.yaml' 2026-09-01T00:16:53,577 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/african-english/utils.py' 2026-09-01T00:16:53,579 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand' 2026-09-01T00:16:53,580 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-amh.yaml' 2026-09-01T00:16:53,581 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-hau.yaml' 2026-09-01T00:16:53,582 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-ibo.yaml' 2026-09-01T00:16:53,584 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-kin.yaml' 2026-09-01T00:16:53,585 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-lug.yaml' 2026-09-01T00:16:53,586 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-luo.yaml' 2026-09-01T00:16:53,587 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-nya.yaml' 2026-09-01T00:16:53,588 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-pcm.yaml' 2026-09-01T00:16:53,590 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-sna.yaml' 2026-09-01T00:16:53,591 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-swa.yaml' 2026-09-01T00:16:53,592 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-tsn.yaml' 2026-09-01T00:16:53,593 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-twi.yaml' 2026-09-01T00:16:53,594 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-xho.yaml' 2026-09-01T00:16:53,595 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-yor.yaml' 2026-09-01T00:16:53,597 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_en-zul.yaml' 2026-09-01T00:16:53,598 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bam.yaml' 2026-09-01T00:16:53,599 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-bbj.yaml' 2026-09-01T00:16:53,600 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-ewe.yaml' 2026-09-01T00:16:53,601 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-fon.yaml' 2026-09-01T00:16:53,602 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-mos.yaml' 2026-09-01T00:16:53,604 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/mafand_fr-wol.yaml' 2026-09-01T00:16:53,605 adding 'lm_eval/tasks/afrobench/mafand/prompt_3/english-african/utils.py' 2026-09-01T00:16:53,607 adding 'lm_eval/tasks/afrobench/masakhaner/README.md' 2026-09-01T00:16:53,609 adding 'lm_eval/tasks/afrobench/masakhaner/gen_utils.py' 2026-09-01T00:16:53,610 adding 'lm_eval/tasks/afrobench/masakhaner/masakhaner.yaml' 2026-09-01T00:16:53,612 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner' 2026-09-01T00:16:53,613 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_am.yaml' 2026-09-01T00:16:53,614 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bbj.yaml' 2026-09-01T00:16:53,615 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_bm.yaml' 2026-09-01T00:16:53,617 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ee.yaml' 2026-09-01T00:16:53,618 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ha.yaml' 2026-09-01T00:16:53,619 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ig.yaml' 2026-09-01T00:16:53,620 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_lg.yaml' 2026-09-01T00:16:53,621 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_luo.yaml' 2026-09-01T00:16:53,622 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_mos.yaml' 2026-09-01T00:16:53,624 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_ny.yaml' 2026-09-01T00:16:53,625 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_pcm.yaml' 2026-09-01T00:16:53,626 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_rw.yaml' 2026-09-01T00:16:53,627 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sn.yaml' 2026-09-01T00:16:53,629 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_sw.yaml' 2026-09-01T00:16:53,630 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tn.yaml' 2026-09-01T00:16:53,631 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_tw.yaml' 2026-09-01T00:16:53,632 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_wo.yaml' 2026-09-01T00:16:53,633 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_xh.yaml' 2026-09-01T00:16:53,634 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_yo.yaml' 2026-09-01T00:16:53,636 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/masakhaner_zu.yaml' 2026-09-01T00:16:53,637 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_1/utils.py' 2026-09-01T00:16:53,639 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner' 2026-09-01T00:16:53,640 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_am.yaml' 2026-09-01T00:16:53,641 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bbj.yaml' 2026-09-01T00:16:53,643 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_bm.yaml' 2026-09-01T00:16:53,644 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ee.yaml' 2026-09-01T00:16:53,645 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ha.yaml' 2026-09-01T00:16:53,646 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ig.yaml' 2026-09-01T00:16:53,648 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_lg.yaml' 2026-09-01T00:16:53,649 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_luo.yaml' 2026-09-01T00:16:53,650 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_mos.yaml' 2026-09-01T00:16:53,651 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_ny.yaml' 2026-09-01T00:16:53,653 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_pcm.yaml' 2026-09-01T00:16:53,654 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_rw.yaml' 2026-09-01T00:16:53,655 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sn.yaml' 2026-09-01T00:16:53,656 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_sw.yaml' 2026-09-01T00:16:53,658 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tn.yaml' 2026-09-01T00:16:53,659 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_tw.yaml' 2026-09-01T00:16:53,660 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_wo.yaml' 2026-09-01T00:16:53,661 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_xh.yaml' 2026-09-01T00:16:53,663 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_yo.yaml' 2026-09-01T00:16:53,664 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/masakhaner_zu.yaml' 2026-09-01T00:16:53,665 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_2/utils.py' 2026-09-01T00:16:53,667 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner' 2026-09-01T00:16:53,668 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_am.yaml' 2026-09-01T00:16:53,670 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bbj.yaml' 2026-09-01T00:16:53,671 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_bm.yaml' 2026-09-01T00:16:53,672 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ee.yaml' 2026-09-01T00:16:53,673 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ha.yaml' 2026-09-01T00:16:53,674 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ig.yaml' 2026-09-01T00:16:53,675 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_lg.yaml' 2026-09-01T00:16:53,677 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_luo.yaml' 2026-09-01T00:16:53,678 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_mos.yaml' 2026-09-01T00:16:53,679 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_ny.yaml' 2026-09-01T00:16:53,680 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_pcm.yaml' 2026-09-01T00:16:53,682 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_rw.yaml' 2026-09-01T00:16:53,683 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sn.yaml' 2026-09-01T00:16:53,684 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_sw.yaml' 2026-09-01T00:16:53,685 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tn.yaml' 2026-09-01T00:16:53,687 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_tw.yaml' 2026-09-01T00:16:53,688 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_wo.yaml' 2026-09-01T00:16:53,689 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_xh.yaml' 2026-09-01T00:16:53,690 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_yo.yaml' 2026-09-01T00:16:53,691 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/masakhaner_zu.yaml' 2026-09-01T00:16:53,693 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_3/utils.py' 2026-09-01T00:16:53,695 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner' 2026-09-01T00:16:53,696 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_am.yaml' 2026-09-01T00:16:53,698 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bbj.yaml' 2026-09-01T00:16:53,699 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_bm.yaml' 2026-09-01T00:16:53,700 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ee.yaml' 2026-09-01T00:16:53,701 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ha.yaml' 2026-09-01T00:16:53,702 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ig.yaml' 2026-09-01T00:16:53,704 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_lg.yaml' 2026-09-01T00:16:53,705 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_luo.yaml' 2026-09-01T00:16:53,706 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_mos.yaml' 2026-09-01T00:16:53,707 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_ny.yaml' 2026-09-01T00:16:53,709 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_pcm.yaml' 2026-09-01T00:16:53,710 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_rw.yaml' 2026-09-01T00:16:53,711 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sn.yaml' 2026-09-01T00:16:53,712 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_sw.yaml' 2026-09-01T00:16:53,713 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tn.yaml' 2026-09-01T00:16:53,715 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_tw.yaml' 2026-09-01T00:16:53,716 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_wo.yaml' 2026-09-01T00:16:53,717 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_xh.yaml' 2026-09-01T00:16:53,718 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_yo.yaml' 2026-09-01T00:16:53,719 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/masakhaner_zu.yaml' 2026-09-01T00:16:53,721 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_4/utils.py' 2026-09-01T00:16:53,723 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner' 2026-09-01T00:16:53,724 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_am.yaml' 2026-09-01T00:16:53,725 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bbj.yaml' 2026-09-01T00:16:53,726 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_bm.yaml' 2026-09-01T00:16:53,727 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ee.yaml' 2026-09-01T00:16:53,728 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ha.yaml' 2026-09-01T00:16:53,730 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ig.yaml' 2026-09-01T00:16:53,731 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_lg.yaml' 2026-09-01T00:16:53,732 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_luo.yaml' 2026-09-01T00:16:53,733 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_mos.yaml' 2026-09-01T00:16:53,734 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_ny.yaml' 2026-09-01T00:16:53,736 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_pcm.yaml' 2026-09-01T00:16:53,737 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_rw.yaml' 2026-09-01T00:16:53,738 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sn.yaml' 2026-09-01T00:16:53,739 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_sw.yaml' 2026-09-01T00:16:53,740 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tn.yaml' 2026-09-01T00:16:53,741 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_tw.yaml' 2026-09-01T00:16:53,742 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_wo.yaml' 2026-09-01T00:16:53,744 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_xh.yaml' 2026-09-01T00:16:53,745 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_yo.yaml' 2026-09-01T00:16:53,746 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/masakhaner_zu.yaml' 2026-09-01T00:16:53,748 adding 'lm_eval/tasks/afrobench/masakhaner/prompt_5/utils.py' 2026-09-01T00:16:53,750 adding 'lm_eval/tasks/afrobench/masakhanews/README.md' 2026-09-01T00:16:53,751 adding 'lm_eval/tasks/afrobench/masakhanews/masakhanews.yaml' 2026-09-01T00:16:53,753 adding 'lm_eval/tasks/afrobench/masakhanews/utils.py' 2026-09-01T00:16:53,755 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews' 2026-09-01T00:16:53,756 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_amh.yaml' 2026-09-01T00:16:53,757 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_eng.yaml' 2026-09-01T00:16:53,758 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_fra.yaml' 2026-09-01T00:16:53,759 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_hau.yaml' 2026-09-01T00:16:53,761 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_ibo.yaml' 2026-09-01T00:16:53,762 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lin.yaml' 2026-09-01T00:16:53,763 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_lug.yaml' 2026-09-01T00:16:53,764 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_orm.yaml' 2026-09-01T00:16:53,766 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_pcm.yaml' 2026-09-01T00:16:53,767 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_run.yaml' 2026-09-01T00:16:53,768 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_sna.yaml' 2026-09-01T00:16:53,769 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_som.yaml' 2026-09-01T00:16:53,770 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_swa.yaml' 2026-09-01T00:16:53,772 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_tir.yaml' 2026-09-01T00:16:53,773 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_xho.yaml' 2026-09-01T00:16:53,774 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/masakhanews_yor.yaml' 2026-09-01T00:16:53,775 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_1/utils.py' 2026-09-01T00:16:53,777 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews' 2026-09-01T00:16:53,778 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_amh.yaml' 2026-09-01T00:16:53,779 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_eng.yaml' 2026-09-01T00:16:53,780 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_fra.yaml' 2026-09-01T00:16:53,781 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_hau.yaml' 2026-09-01T00:16:53,782 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_ibo.yaml' 2026-09-01T00:16:53,783 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lin.yaml' 2026-09-01T00:16:53,785 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_lug.yaml' 2026-09-01T00:16:53,786 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_orm.yaml' 2026-09-01T00:16:53,787 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_pcm.yaml' 2026-09-01T00:16:53,788 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_run.yaml' 2026-09-01T00:16:53,789 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_sna.yaml' 2026-09-01T00:16:53,790 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_som.yaml' 2026-09-01T00:16:53,791 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_swa.yaml' 2026-09-01T00:16:53,792 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_tir.yaml' 2026-09-01T00:16:53,794 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_xho.yaml' 2026-09-01T00:16:53,795 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/masakhanews_yor.yaml' 2026-09-01T00:16:53,796 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_2/utils.py' 2026-09-01T00:16:53,798 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews' 2026-09-01T00:16:53,799 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_amh.yaml' 2026-09-01T00:16:53,800 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_eng.yaml' 2026-09-01T00:16:53,801 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_fra.yaml' 2026-09-01T00:16:53,803 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_hau.yaml' 2026-09-01T00:16:53,804 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_ibo.yaml' 2026-09-01T00:16:53,805 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lin.yaml' 2026-09-01T00:16:53,806 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_lug.yaml' 2026-09-01T00:16:53,808 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_orm.yaml' 2026-09-01T00:16:53,809 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_pcm.yaml' 2026-09-01T00:16:53,810 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_run.yaml' 2026-09-01T00:16:53,811 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_sna.yaml' 2026-09-01T00:16:53,812 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_som.yaml' 2026-09-01T00:16:53,814 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_swa.yaml' 2026-09-01T00:16:53,815 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_tir.yaml' 2026-09-01T00:16:53,816 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_xho.yaml' 2026-09-01T00:16:53,817 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/masakhanews_yor.yaml' 2026-09-01T00:16:53,818 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_3/utils.py' 2026-09-01T00:16:53,820 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews' 2026-09-01T00:16:53,822 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_amh.yaml' 2026-09-01T00:16:53,823 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_eng.yaml' 2026-09-01T00:16:53,824 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_fra.yaml' 2026-09-01T00:16:53,825 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_hau.yaml' 2026-09-01T00:16:53,826 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_ibo.yaml' 2026-09-01T00:16:53,828 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lin.yaml' 2026-09-01T00:16:53,829 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_lug.yaml' 2026-09-01T00:16:53,830 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_orm.yaml' 2026-09-01T00:16:53,831 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_pcm.yaml' 2026-09-01T00:16:53,832 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_run.yaml' 2026-09-01T00:16:53,833 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_sna.yaml' 2026-09-01T00:16:53,835 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_som.yaml' 2026-09-01T00:16:53,836 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_swa.yaml' 2026-09-01T00:16:53,837 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_tir.yaml' 2026-09-01T00:16:53,838 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_xho.yaml' 2026-09-01T00:16:53,839 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/masakhanews_yor.yaml' 2026-09-01T00:16:53,840 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_4/utils.py' 2026-09-01T00:16:53,842 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews' 2026-09-01T00:16:53,844 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_amh.yaml' 2026-09-01T00:16:53,845 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_eng.yaml' 2026-09-01T00:16:53,846 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_fra.yaml' 2026-09-01T00:16:53,847 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_hau.yaml' 2026-09-01T00:16:53,848 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_ibo.yaml' 2026-09-01T00:16:53,850 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lin.yaml' 2026-09-01T00:16:53,851 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_lug.yaml' 2026-09-01T00:16:53,852 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_orm.yaml' 2026-09-01T00:16:53,854 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_pcm.yaml' 2026-09-01T00:16:53,855 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_run.yaml' 2026-09-01T00:16:53,856 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_sna.yaml' 2026-09-01T00:16:53,858 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_som.yaml' 2026-09-01T00:16:53,859 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_swa.yaml' 2026-09-01T00:16:53,860 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_tir.yaml' 2026-09-01T00:16:53,862 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_xho.yaml' 2026-09-01T00:16:53,863 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/masakhanews_yor.yaml' 2026-09-01T00:16:53,864 adding 'lm_eval/tasks/afrobench/masakhanews/prompt_5/utils.py' 2026-09-01T00:16:53,867 adding 'lm_eval/tasks/afrobench/masakhapos/README.md' 2026-09-01T00:16:53,869 adding 'lm_eval/tasks/afrobench/masakhapos/gen_utils.py' 2026-09-01T00:16:53,870 adding 'lm_eval/tasks/afrobench/masakhapos/masakhapos.yaml' 2026-09-01T00:16:53,871 adding 'lm_eval/tasks/afrobench/masakhapos/utils.py' 2026-09-01T00:16:53,873 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bam.yaml' 2026-09-01T00:16:53,875 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_bbj.yaml' 2026-09-01T00:16:53,876 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ewe.yaml' 2026-09-01T00:16:53,878 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_fon.yaml' 2026-09-01T00:16:53,879 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_hau.yaml' 2026-09-01T00:16:53,880 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_ibo.yaml' 2026-09-01T00:16:53,881 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_kin.yaml' 2026-09-01T00:16:53,882 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_lug.yaml' 2026-09-01T00:16:53,883 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_luo.yaml' 2026-09-01T00:16:53,885 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_mos.yaml' 2026-09-01T00:16:53,886 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_nya.yaml' 2026-09-01T00:16:53,887 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_pcm.yaml' 2026-09-01T00:16:53,888 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_sna.yaml' 2026-09-01T00:16:53,889 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_swa.yaml' 2026-09-01T00:16:53,891 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_tsn.yaml' 2026-09-01T00:16:53,892 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_twi.yaml' 2026-09-01T00:16:53,893 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_wol.yaml' 2026-09-01T00:16:53,894 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_xho.yaml' 2026-09-01T00:16:53,896 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yaml' 2026-09-01T00:16:53,897 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_yor.yaml' 2026-09-01T00:16:53,898 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/masakhapos_zul.yaml' 2026-09-01T00:16:53,899 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_1/utils.py' 2026-09-01T00:16:53,901 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bam.yaml' 2026-09-01T00:16:53,903 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_bbj.yaml' 2026-09-01T00:16:53,904 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ewe.yaml' 2026-09-01T00:16:53,905 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_fon.yaml' 2026-09-01T00:16:53,907 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_hau.yaml' 2026-09-01T00:16:53,908 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_ibo.yaml' 2026-09-01T00:16:53,909 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_kin.yaml' 2026-09-01T00:16:53,910 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_lug.yaml' 2026-09-01T00:16:53,912 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_luo.yaml' 2026-09-01T00:16:53,913 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_mos.yaml' 2026-09-01T00:16:53,914 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_nya.yaml' 2026-09-01T00:16:53,915 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_pcm.yaml' 2026-09-01T00:16:53,917 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_sna.yaml' 2026-09-01T00:16:53,918 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_swa.yaml' 2026-09-01T00:16:53,919 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_tsn.yaml' 2026-09-01T00:16:53,920 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_twi.yaml' 2026-09-01T00:16:53,922 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_wol.yaml' 2026-09-01T00:16:53,923 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_xho.yaml' 2026-09-01T00:16:53,924 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yaml' 2026-09-01T00:16:53,926 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_yor.yaml' 2026-09-01T00:16:53,927 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/masakhapos_zul.yaml' 2026-09-01T00:16:53,928 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_2/utils.py' 2026-09-01T00:16:53,930 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bam.yaml' 2026-09-01T00:16:53,931 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_bbj.yaml' 2026-09-01T00:16:53,933 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ewe.yaml' 2026-09-01T00:16:53,934 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_fon.yaml' 2026-09-01T00:16:53,935 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_hau.yaml' 2026-09-01T00:16:53,936 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_ibo.yaml' 2026-09-01T00:16:53,938 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_kin.yaml' 2026-09-01T00:16:53,939 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_lug.yaml' 2026-09-01T00:16:53,940 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_luo.yaml' 2026-09-01T00:16:53,941 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_mos.yaml' 2026-09-01T00:16:53,943 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_nya.yaml' 2026-09-01T00:16:53,944 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_pcm.yaml' 2026-09-01T00:16:53,945 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_sna.yaml' 2026-09-01T00:16:53,947 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_swa.yaml' 2026-09-01T00:16:53,948 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_tsn.yaml' 2026-09-01T00:16:53,949 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_twi.yaml' 2026-09-01T00:16:53,950 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_wol.yaml' 2026-09-01T00:16:53,952 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_xho.yaml' 2026-09-01T00:16:53,953 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yaml' 2026-09-01T00:16:53,954 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_yor.yaml' 2026-09-01T00:16:53,955 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/masakhapos_zul.yaml' 2026-09-01T00:16:53,957 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_3/utils.py' 2026-09-01T00:16:53,958 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bam.yaml' 2026-09-01T00:16:53,960 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_bbj.yaml' 2026-09-01T00:16:53,961 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ewe.yaml' 2026-09-01T00:16:53,962 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_fon.yaml' 2026-09-01T00:16:53,963 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_hau.yaml' 2026-09-01T00:16:53,965 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_ibo.yaml' 2026-09-01T00:16:53,966 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_kin.yaml' 2026-09-01T00:16:53,967 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_lug.yaml' 2026-09-01T00:16:53,968 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_luo.yaml' 2026-09-01T00:16:53,970 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_mos.yaml' 2026-09-01T00:16:53,971 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_nya.yaml' 2026-09-01T00:16:53,972 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_pcm.yaml' 2026-09-01T00:16:53,973 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_sna.yaml' 2026-09-01T00:16:53,975 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_swa.yaml' 2026-09-01T00:16:53,976 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_tsn.yaml' 2026-09-01T00:16:53,977 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_twi.yaml' 2026-09-01T00:16:53,979 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_wol.yaml' 2026-09-01T00:16:53,980 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_xho.yaml' 2026-09-01T00:16:53,981 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yaml' 2026-09-01T00:16:53,983 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_yor.yaml' 2026-09-01T00:16:53,984 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/masakhapos_zul.yaml' 2026-09-01T00:16:53,985 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_4/utils.py' 2026-09-01T00:16:53,987 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bam.yaml' 2026-09-01T00:16:53,989 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_bbj.yaml' 2026-09-01T00:16:53,990 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ewe.yaml' 2026-09-01T00:16:53,991 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_fon.yaml' 2026-09-01T00:16:53,992 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_hau.yaml' 2026-09-01T00:16:53,994 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_ibo.yaml' 2026-09-01T00:16:53,995 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_kin.yaml' 2026-09-01T00:16:53,996 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_lug.yaml' 2026-09-01T00:16:53,997 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_luo.yaml' 2026-09-01T00:16:53,999 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_mos.yaml' 2026-09-01T00:16:54,000 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_nya.yaml' 2026-09-01T00:16:54,001 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_pcm.yaml' 2026-09-01T00:16:54,003 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_sna.yaml' 2026-09-01T00:16:54,004 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_swa.yaml' 2026-09-01T00:16:54,005 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_tsn.yaml' 2026-09-01T00:16:54,006 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_twi.yaml' 2026-09-01T00:16:54,008 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_wol.yaml' 2026-09-01T00:16:54,009 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_xho.yaml' 2026-09-01T00:16:54,010 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yaml' 2026-09-01T00:16:54,012 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_yor.yaml' 2026-09-01T00:16:54,013 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/masakhapos_zul.yaml' 2026-09-01T00:16:54,014 adding 'lm_eval/tasks/afrobench/masakhapos/prompt_5/utils.py' 2026-09-01T00:16:54,016 adding 'lm_eval/tasks/afrobench/naijarc/README.md' 2026-09-01T00:16:54,017 adding 'lm_eval/tasks/afrobench/naijarc/naijarc.yaml' 2026-09-01T00:16:54,019 adding 'lm_eval/tasks/afrobench/naijarc/utils.py' 2026-09-01T00:16:54,021 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc' 2026-09-01T00:16:54,022 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_hau.yaml' 2026-09-01T00:16:54,023 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_ibo.yaml' 2026-09-01T00:16:54,024 adding 'lm_eval/tasks/afrobench/naijarc/prompt_1/naijarc_yor.yaml' 2026-09-01T00:16:54,026 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc' 2026-09-01T00:16:54,027 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_hau.yaml' 2026-09-01T00:16:54,028 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_ibo.yaml' 2026-09-01T00:16:54,030 adding 'lm_eval/tasks/afrobench/naijarc/prompt_2/naijarc_yor.yaml' 2026-09-01T00:16:54,032 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc' 2026-09-01T00:16:54,033 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_hau.yaml' 2026-09-01T00:16:54,034 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_ibo.yaml' 2026-09-01T00:16:54,035 adding 'lm_eval/tasks/afrobench/naijarc/prompt_3/naijarc_yor.yaml' 2026-09-01T00:16:54,037 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc' 2026-09-01T00:16:54,038 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_hau.yaml' 2026-09-01T00:16:54,040 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_ibo.yaml' 2026-09-01T00:16:54,041 adding 'lm_eval/tasks/afrobench/naijarc/prompt_4/naijarc_yor.yaml' 2026-09-01T00:16:54,043 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc' 2026-09-01T00:16:54,044 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_hau.yaml' 2026-09-01T00:16:54,045 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_ibo.yaml' 2026-09-01T00:16:54,046 adding 'lm_eval/tasks/afrobench/naijarc/prompt_5/naijarc_yor.yaml' 2026-09-01T00:16:54,048 adding 'lm_eval/tasks/afrobench/nollysenti/README.md' 2026-09-01T00:16:54,049 adding 'lm_eval/tasks/afrobench/nollysenti/nollysenti.yaml' 2026-09-01T00:16:54,051 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti' 2026-09-01T00:16:54,052 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_eng.yaml' 2026-09-01T00:16:54,053 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_hau.yaml' 2026-09-01T00:16:54,054 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_ibo.yaml' 2026-09-01T00:16:54,055 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_pcm.yaml' 2026-09-01T00:16:54,056 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/nollysenti_yor.yaml' 2026-09-01T00:16:54,058 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_1/utils.py' 2026-09-01T00:16:54,059 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti' 2026-09-01T00:16:54,060 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_eng.yaml' 2026-09-01T00:16:54,062 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_hau.yaml' 2026-09-01T00:16:54,063 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_ibo.yaml' 2026-09-01T00:16:54,064 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_pcm.yaml' 2026-09-01T00:16:54,065 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/nollysenti_yor.yaml' 2026-09-01T00:16:54,066 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_2/utils.py' 2026-09-01T00:16:54,068 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti' 2026-09-01T00:16:54,069 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_eng.yaml' 2026-09-01T00:16:54,070 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_hau.yaml' 2026-09-01T00:16:54,071 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_ibo.yaml' 2026-09-01T00:16:54,073 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_pcm.yaml' 2026-09-01T00:16:54,074 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/nollysenti_yor.yaml' 2026-09-01T00:16:54,075 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_3/utils.py' 2026-09-01T00:16:54,077 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti' 2026-09-01T00:16:54,078 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_eng.yaml' 2026-09-01T00:16:54,079 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_hau.yaml' 2026-09-01T00:16:54,080 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_ibo.yaml' 2026-09-01T00:16:54,081 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_pcm.yaml' 2026-09-01T00:16:54,083 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/nollysenti_yor.yaml' 2026-09-01T00:16:54,084 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_4/utils.py' 2026-09-01T00:16:54,086 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti' 2026-09-01T00:16:54,087 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_eng.yaml' 2026-09-01T00:16:54,088 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_hau.yaml' 2026-09-01T00:16:54,089 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_ibo.yaml' 2026-09-01T00:16:54,091 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_pcm.yaml' 2026-09-01T00:16:54,092 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/nollysenti_yor.yaml' 2026-09-01T00:16:54,093 adding 'lm_eval/tasks/afrobench/nollysenti/prompt_5/utils.py' 2026-09-01T00:16:54,095 adding 'lm_eval/tasks/afrobench/ntrex/README.md' 2026-09-01T00:16:54,097 adding 'lm_eval/tasks/afrobench/ntrex/gen_utils.py' 2026-09-01T00:16:54,098 adding 'lm_eval/tasks/afrobench/ntrex/ntrex.yaml' 2026-09-01T00:16:54,101 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex' 2026-09-01T00:16:54,102 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,103 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,104 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,105 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,106 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,107 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,109 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,110 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,111 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,112 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,113 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,115 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,116 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,117 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,118 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,119 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,121 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,122 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,123 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,124 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,125 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,126 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-09-01T00:16:54,127 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-09-01T00:16:54,129 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,130 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,131 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,132 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,133 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,134 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,136 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,137 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,138 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,140 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex' 2026-09-01T00:16:54,141 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-09-01T00:16:54,143 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:16:54,144 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-09-01T00:16:54,145 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-09-01T00:16:54,146 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:16:54,147 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-09-01T00:16:54,148 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-09-01T00:16:54,149 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:16:54,150 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-09-01T00:16:54,152 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-09-01T00:16:54,153 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-09-01T00:16:54,154 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-09-01T00:16:54,155 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-09-01T00:16:54,156 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-09-01T00:16:54,158 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-09-01T00:16:54,159 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-09-01T00:16:54,160 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-09-01T00:16:54,161 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-09-01T00:16:54,162 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-09-01T00:16:54,164 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:16:54,165 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-09-01T00:16:54,166 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-09-01T00:16:54,167 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-09-01T00:16:54,168 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:16:54,169 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-09-01T00:16:54,171 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:16:54,172 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-09-01T00:16:54,173 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-09-01T00:16:54,174 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-09-01T00:16:54,175 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-09-01T00:16:54,177 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-09-01T00:16:54,178 adding 'lm_eval/tasks/afrobench/ntrex/prompt_1/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-09-01T00:16:54,180 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex' 2026-09-01T00:16:54,182 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,183 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,184 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,185 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,187 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,188 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,189 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,190 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,191 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,192 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,193 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,195 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,196 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,197 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,198 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,199 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,201 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,202 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,203 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,204 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,205 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,207 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-09-01T00:16:54,208 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-09-01T00:16:54,209 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,210 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,212 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,213 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,214 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,215 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,216 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,218 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,219 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,221 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex' 2026-09-01T00:16:54,223 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-09-01T00:16:54,224 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:16:54,225 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-09-01T00:16:54,227 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-09-01T00:16:54,228 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:16:54,229 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-09-01T00:16:54,230 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-09-01T00:16:54,231 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:16:54,233 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-09-01T00:16:54,234 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-09-01T00:16:54,235 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-09-01T00:16:54,236 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-09-01T00:16:54,237 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-09-01T00:16:54,238 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-09-01T00:16:54,240 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-09-01T00:16:54,241 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-09-01T00:16:54,242 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-09-01T00:16:54,243 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-09-01T00:16:54,244 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-09-01T00:16:54,246 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:16:54,247 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-09-01T00:16:54,248 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-09-01T00:16:54,249 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-09-01T00:16:54,250 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:16:54,252 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-09-01T00:16:54,253 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:16:54,254 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-09-01T00:16:54,255 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-09-01T00:16:54,256 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-09-01T00:16:54,257 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-09-01T00:16:54,259 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-09-01T00:16:54,260 adding 'lm_eval/tasks/afrobench/ntrex/prompt_2/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-09-01T00:16:54,263 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex' 2026-09-01T00:16:54,264 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_afr_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,265 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_amh_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,266 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_arb_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,267 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_bem_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,269 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ewe_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,270 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_fra_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,271 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_hau_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,272 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ibo_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,274 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_kin_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,275 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mey_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,276 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_mlg_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,277 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_msa_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,278 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nde_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,279 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nso_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,280 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_nya_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,281 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_orm_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,283 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_shi_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,284 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_sna_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,285 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_som_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,286 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ssw_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,287 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_swa_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,288 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tam_Taml-eng_Latn.yaml' 2026-09-01T00:16:54,290 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tel_Telu-eng_Latn.yaml' 2026-09-01T00:16:54,291 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tir_Ethi-eng_Latn.yaml' 2026-09-01T00:16:54,292 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ton_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,293 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_tsn_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,294 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_urd_Arab-eng_Latn.yaml' 2026-09-01T00:16:54,295 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_ven_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,297 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_wol_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,298 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_xho_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,299 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_yor_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,300 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/african-english/ntrex_zul_Latn-eng_Latn.yaml' 2026-09-01T00:16:54,302 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex' 2026-09-01T00:16:54,303 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-afr_Latn.yaml' 2026-09-01T00:16:54,305 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-amh_Ethi.yaml' 2026-09-01T00:16:54,306 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-arb_Arab.yaml' 2026-09-01T00:16:54,307 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-bem_Latn.yaml' 2026-09-01T00:16:54,308 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ewe_Latn.yaml' 2026-09-01T00:16:54,309 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-fra_Latn.yaml' 2026-09-01T00:16:54,311 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-hau_Latn.yaml' 2026-09-01T00:16:54,312 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ibo_Latn.yaml' 2026-09-01T00:16:54,313 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-kin_Latn.yaml' 2026-09-01T00:16:54,314 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mey_Arab.yaml' 2026-09-01T00:16:54,316 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-mlg_Latn.yaml' 2026-09-01T00:16:54,317 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-msa_Latn.yaml' 2026-09-01T00:16:54,318 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nde_Latn.yaml' 2026-09-01T00:16:54,319 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nso_Latn.yaml' 2026-09-01T00:16:54,320 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-nya_Latn.yaml' 2026-09-01T00:16:54,321 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-orm_Ethi.yaml' 2026-09-01T00:16:54,323 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-shi_Arab.yaml' 2026-09-01T00:16:54,324 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-sna_Latn.yaml' 2026-09-01T00:16:54,325 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-som_Latn.yaml' 2026-09-01T00:16:54,326 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ssw_Latn.yaml' 2026-09-01T00:16:54,328 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-swa_Latn.yaml' 2026-09-01T00:16:54,329 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tam_Taml.yaml' 2026-09-01T00:16:54,330 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tel_Telu.yaml' 2026-09-01T00:16:54,331 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tir_Ethi.yaml' 2026-09-01T00:16:54,332 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ton_Latn.yaml' 2026-09-01T00:16:54,334 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-tsn_Latn.yaml' 2026-09-01T00:16:54,335 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-urd_Arab.yaml' 2026-09-01T00:16:54,336 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-ven_Latn.yaml' 2026-09-01T00:16:54,337 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-wol_Latn.yaml' 2026-09-01T00:16:54,338 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-xho_Latn.yaml' 2026-09-01T00:16:54,339 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-yor_Latn.yaml' 2026-09-01T00:16:54,341 adding 'lm_eval/tasks/afrobench/ntrex/prompt_3/english-african/ntrex_eng_Latn-zul_Latn.yaml' 2026-09-01T00:16:54,342 adding 'lm_eval/tasks/afrobench/openai_mmlu/README.md' 2026-09-01T00:16:54,344 adding 'lm_eval/tasks/afrobench/openai_mmlu/openai_mmlu.yaml' 2026-09-01T00:16:54,345 adding 'lm_eval/tasks/afrobench/openai_mmlu/utils.py' 2026-09-01T00:16:54,347 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu' 2026-09-01T00:16:54,348 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_ara.yaml' 2026-09-01T00:16:54,349 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_swa.yaml' 2026-09-01T00:16:54,351 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_1/openai_mmlu_yor.yaml' 2026-09-01T00:16:54,352 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu' 2026-09-01T00:16:54,354 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_ara.yaml' 2026-09-01T00:16:54,355 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_swa.yaml' 2026-09-01T00:16:54,356 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_2/openai_mmlu_yor.yaml' 2026-09-01T00:16:54,358 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu' 2026-09-01T00:16:54,359 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_ara.yaml' 2026-09-01T00:16:54,361 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_swa.yaml' 2026-09-01T00:16:54,362 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_3/openai_mmlu_yor.yaml' 2026-09-01T00:16:54,363 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu' 2026-09-01T00:16:54,365 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_ara.yaml' 2026-09-01T00:16:54,366 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_swa.yaml' 2026-09-01T00:16:54,367 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_4/openai_mmlu_yor.yaml' 2026-09-01T00:16:54,369 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu' 2026-09-01T00:16:54,370 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_ara.yaml' 2026-09-01T00:16:54,371 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_swa.yaml' 2026-09-01T00:16:54,372 adding 'lm_eval/tasks/afrobench/openai_mmlu/prompt_5/openai_mmlu_yor.yaml' 2026-09-01T00:16:54,374 adding 'lm_eval/tasks/afrobench/salt/README.md' 2026-09-01T00:16:54,376 adding 'lm_eval/tasks/afrobench/salt/gen_utils.py' 2026-09-01T00:16:54,377 adding 'lm_eval/tasks/afrobench/salt/salt.yaml' 2026-09-01T00:16:54,379 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt' 2026-09-01T00:16:54,380 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ach-eng.yaml' 2026-09-01T00:16:54,381 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ach.yaml' 2026-09-01T00:16:54,382 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-ibo.yaml' 2026-09-01T00:16:54,383 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lgg.yaml' 2026-09-01T00:16:54,384 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-lug.yaml' 2026-09-01T00:16:54,386 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-nyn.yaml' 2026-09-01T00:16:54,387 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-swa.yaml' 2026-09-01T00:16:54,388 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_eng-teo.yaml' 2026-09-01T00:16:54,389 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_ibo-eng.yaml' 2026-09-01T00:16:54,390 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lgg-eng.yaml' 2026-09-01T00:16:54,391 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_lug-eng.yaml' 2026-09-01T00:16:54,393 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_nyn-eng.yaml' 2026-09-01T00:16:54,394 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_swa-eng.yaml' 2026-09-01T00:16:54,395 adding 'lm_eval/tasks/afrobench/salt/prompt_1/salt_teo-eng.yaml' 2026-09-01T00:16:54,397 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt' 2026-09-01T00:16:54,398 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ach-eng.yaml' 2026-09-01T00:16:54,399 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ach.yaml' 2026-09-01T00:16:54,401 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-ibo.yaml' 2026-09-01T00:16:54,402 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lgg.yaml' 2026-09-01T00:16:54,403 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-lug.yaml' 2026-09-01T00:16:54,404 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-nyn.yaml' 2026-09-01T00:16:54,406 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-swa.yaml' 2026-09-01T00:16:54,407 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_eng-teo.yaml' 2026-09-01T00:16:54,408 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_ibo-eng.yaml' 2026-09-01T00:16:54,410 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lgg-eng.yaml' 2026-09-01T00:16:54,411 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_lug-eng.yaml' 2026-09-01T00:16:54,412 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_nyn-eng.yaml' 2026-09-01T00:16:54,414 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_swa-eng.yaml' 2026-09-01T00:16:54,415 adding 'lm_eval/tasks/afrobench/salt/prompt_2/salt_teo-eng.yaml' 2026-09-01T00:16:54,418 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt' 2026-09-01T00:16:54,419 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ach-eng.yaml' 2026-09-01T00:16:54,420 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ach.yaml' 2026-09-01T00:16:54,421 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-ibo.yaml' 2026-09-01T00:16:54,422 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lgg.yaml' 2026-09-01T00:16:54,423 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-lug.yaml' 2026-09-01T00:16:54,425 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-nyn.yaml' 2026-09-01T00:16:54,426 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-swa.yaml' 2026-09-01T00:16:54,427 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_eng-teo.yaml' 2026-09-01T00:16:54,429 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_ibo-eng.yaml' 2026-09-01T00:16:54,430 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lgg-eng.yaml' 2026-09-01T00:16:54,431 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_lug-eng.yaml' 2026-09-01T00:16:54,432 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_nyn-eng.yaml' 2026-09-01T00:16:54,433 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_swa-eng.yaml' 2026-09-01T00:16:54,435 adding 'lm_eval/tasks/afrobench/salt/prompt_3/salt_teo-eng.yaml' 2026-09-01T00:16:54,436 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench.sh' 2026-09-01T00:16:54,438 adding 'lm_eval/tasks/afrobench/sample_run_scripts/run_afrobench_lite.sh' 2026-09-01T00:16:54,440 adding 'lm_eval/tasks/afrobench/sib/README.md' 2026-09-01T00:16:54,441 adding 'lm_eval/tasks/afrobench/sib/sib.yaml' 2026-09-01T00:16:54,443 adding 'lm_eval/tasks/afrobench/sib/utils.py' 2026-09-01T00:16:54,446 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib' 2026-09-01T00:16:54,447 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aeb.yaml' 2026-09-01T00:16:54,448 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_afr.yaml' 2026-09-01T00:16:54,450 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_aka.yaml' 2026-09-01T00:16:54,451 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_amh.yaml' 2026-09-01T00:16:54,452 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ary.yaml' 2026-09-01T00:16:54,454 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_arz.yaml' 2026-09-01T00:16:54,455 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bam.yaml' 2026-09-01T00:16:54,457 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_bem.yaml' 2026-09-01T00:16:54,458 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_cjk.yaml' 2026-09-01T00:16:54,459 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dik.yaml' 2026-09-01T00:16:54,460 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_dyu.yaml' 2026-09-01T00:16:54,461 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_eng.yaml' 2026-09-01T00:16:54,463 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ewe.yaml' 2026-09-01T00:16:54,464 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fon.yaml' 2026-09-01T00:16:54,465 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fra.yaml' 2026-09-01T00:16:54,466 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_fuv.yaml' 2026-09-01T00:16:54,468 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_gaz.yaml' 2026-09-01T00:16:54,469 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_hau.yaml' 2026-09-01T00:16:54,470 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ibo.yaml' 2026-09-01T00:16:54,471 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kab.yaml' 2026-09-01T00:16:54,472 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kam.yaml' 2026-09-01T00:16:54,473 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kbp.yaml' 2026-09-01T00:16:54,475 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kea.yaml' 2026-09-01T00:16:54,476 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kik.yaml' 2026-09-01T00:16:54,477 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kin.yaml' 2026-09-01T00:16:54,478 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kmb.yaml' 2026-09-01T00:16:54,480 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_knc.yaml' 2026-09-01T00:16:54,481 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_kon.yaml' 2026-09-01T00:16:54,482 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lin.yaml' 2026-09-01T00:16:54,483 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lua.yaml' 2026-09-01T00:16:54,485 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_lug.yaml' 2026-09-01T00:16:54,486 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_luo.yaml' 2026-09-01T00:16:54,487 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_mos.yaml' 2026-09-01T00:16:54,488 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nso.yaml' 2026-09-01T00:16:54,489 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nus.yaml' 2026-09-01T00:16:54,490 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_nya.yaml' 2026-09-01T00:16:54,491 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_plt.yaml' 2026-09-01T00:16:54,493 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_por.yaml' 2026-09-01T00:16:54,494 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_run.yaml' 2026-09-01T00:16:54,495 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sag.yaml' 2026-09-01T00:16:54,496 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sna.yaml' 2026-09-01T00:16:54,498 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_som.yaml' 2026-09-01T00:16:54,499 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_sot.yaml' 2026-09-01T00:16:54,501 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_ssw.yaml' 2026-09-01T00:16:54,502 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_swa.yaml' 2026-09-01T00:16:54,503 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_taq.yaml' 2026-09-01T00:16:54,504 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tir.yaml' 2026-09-01T00:16:54,506 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tso.yaml' 2026-09-01T00:16:54,507 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tum.yaml' 2026-09-01T00:16:54,508 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_twi.yaml' 2026-09-01T00:16:54,509 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_tzm.yaml' 2026-09-01T00:16:54,510 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_umb.yaml' 2026-09-01T00:16:54,511 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_wol.yaml' 2026-09-01T00:16:54,513 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_xho.yaml' 2026-09-01T00:16:54,514 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_yor.yaml' 2026-09-01T00:16:54,515 adding 'lm_eval/tasks/afrobench/sib/prompt_1/sib_zul.yaml' 2026-09-01T00:16:54,516 adding 'lm_eval/tasks/afrobench/sib/prompt_1/utils.py' 2026-09-01T00:16:54,519 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib' 2026-09-01T00:16:54,520 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aeb.yaml' 2026-09-01T00:16:54,522 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_afr.yaml' 2026-09-01T00:16:54,523 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_aka.yaml' 2026-09-01T00:16:54,525 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_amh.yaml' 2026-09-01T00:16:54,526 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ary.yaml' 2026-09-01T00:16:54,527 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_arz.yaml' 2026-09-01T00:16:54,528 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bam.yaml' 2026-09-01T00:16:54,529 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_bem.yaml' 2026-09-01T00:16:54,531 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_cjk.yaml' 2026-09-01T00:16:54,532 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dik.yaml' 2026-09-01T00:16:54,533 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_dyu.yaml' 2026-09-01T00:16:54,534 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_eng.yaml' 2026-09-01T00:16:54,536 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ewe.yaml' 2026-09-01T00:16:54,537 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fon.yaml' 2026-09-01T00:16:54,538 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fra.yaml' 2026-09-01T00:16:54,539 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_fuv.yaml' 2026-09-01T00:16:54,540 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_gaz.yaml' 2026-09-01T00:16:54,541 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_hau.yaml' 2026-09-01T00:16:54,543 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ibo.yaml' 2026-09-01T00:16:54,544 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kab.yaml' 2026-09-01T00:16:54,545 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kam.yaml' 2026-09-01T00:16:54,546 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kbp.yaml' 2026-09-01T00:16:54,547 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kea.yaml' 2026-09-01T00:16:54,548 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kik.yaml' 2026-09-01T00:16:54,549 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kin.yaml' 2026-09-01T00:16:54,551 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kmb.yaml' 2026-09-01T00:16:54,552 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_knc.yaml' 2026-09-01T00:16:54,553 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_kon.yaml' 2026-09-01T00:16:54,554 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lin.yaml' 2026-09-01T00:16:54,555 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lua.yaml' 2026-09-01T00:16:54,556 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_lug.yaml' 2026-09-01T00:16:54,558 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_luo.yaml' 2026-09-01T00:16:54,559 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_mos.yaml' 2026-09-01T00:16:54,560 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nso.yaml' 2026-09-01T00:16:54,562 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nus.yaml' 2026-09-01T00:16:54,563 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_nya.yaml' 2026-09-01T00:16:54,564 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_plt.yaml' 2026-09-01T00:16:54,565 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_por.yaml' 2026-09-01T00:16:54,566 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_run.yaml' 2026-09-01T00:16:54,568 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sag.yaml' 2026-09-01T00:16:54,569 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sna.yaml' 2026-09-01T00:16:54,570 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_som.yaml' 2026-09-01T00:16:54,571 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_sot.yaml' 2026-09-01T00:16:54,572 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_ssw.yaml' 2026-09-01T00:16:54,574 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_swa.yaml' 2026-09-01T00:16:54,575 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_taq.yaml' 2026-09-01T00:16:54,576 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tir.yaml' 2026-09-01T00:16:54,577 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tso.yaml' 2026-09-01T00:16:54,578 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tum.yaml' 2026-09-01T00:16:54,580 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_twi.yaml' 2026-09-01T00:16:54,581 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_tzm.yaml' 2026-09-01T00:16:54,582 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_umb.yaml' 2026-09-01T00:16:54,583 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_wol.yaml' 2026-09-01T00:16:54,584 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_xho.yaml' 2026-09-01T00:16:54,585 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_yor.yaml' 2026-09-01T00:16:54,587 adding 'lm_eval/tasks/afrobench/sib/prompt_2/sib_zul.yaml' 2026-09-01T00:16:54,588 adding 'lm_eval/tasks/afrobench/sib/prompt_2/utils.py' 2026-09-01T00:16:54,591 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib' 2026-09-01T00:16:54,592 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aeb.yaml' 2026-09-01T00:16:54,593 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_afr.yaml' 2026-09-01T00:16:54,594 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_aka.yaml' 2026-09-01T00:16:54,596 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_amh.yaml' 2026-09-01T00:16:54,597 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ary.yaml' 2026-09-01T00:16:54,598 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_arz.yaml' 2026-09-01T00:16:54,599 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bam.yaml' 2026-09-01T00:16:54,601 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_bem.yaml' 2026-09-01T00:16:54,602 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_cjk.yaml' 2026-09-01T00:16:54,603 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dik.yaml' 2026-09-01T00:16:54,605 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_dyu.yaml' 2026-09-01T00:16:54,606 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_eng.yaml' 2026-09-01T00:16:54,607 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ewe.yaml' 2026-09-01T00:16:54,608 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fon.yaml' 2026-09-01T00:16:54,609 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fra.yaml' 2026-09-01T00:16:54,610 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_fuv.yaml' 2026-09-01T00:16:54,612 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_gaz.yaml' 2026-09-01T00:16:54,613 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_hau.yaml' 2026-09-01T00:16:54,614 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ibo.yaml' 2026-09-01T00:16:54,615 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kab.yaml' 2026-09-01T00:16:54,617 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kam.yaml' 2026-09-01T00:16:54,618 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kbp.yaml' 2026-09-01T00:16:54,619 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kea.yaml' 2026-09-01T00:16:54,621 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kik.yaml' 2026-09-01T00:16:54,622 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kin.yaml' 2026-09-01T00:16:54,623 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kmb.yaml' 2026-09-01T00:16:54,624 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_knc.yaml' 2026-09-01T00:16:54,626 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_kon.yaml' 2026-09-01T00:16:54,627 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lin.yaml' 2026-09-01T00:16:54,628 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lua.yaml' 2026-09-01T00:16:54,629 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_lug.yaml' 2026-09-01T00:16:54,630 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_luo.yaml' 2026-09-01T00:16:54,632 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_mos.yaml' 2026-09-01T00:16:54,633 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nso.yaml' 2026-09-01T00:16:54,634 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nus.yaml' 2026-09-01T00:16:54,635 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_nya.yaml' 2026-09-01T00:16:54,636 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_plt.yaml' 2026-09-01T00:16:54,638 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_por.yaml' 2026-09-01T00:16:54,639 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_run.yaml' 2026-09-01T00:16:54,640 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sag.yaml' 2026-09-01T00:16:54,641 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sna.yaml' 2026-09-01T00:16:54,642 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_som.yaml' 2026-09-01T00:16:54,644 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_sot.yaml' 2026-09-01T00:16:54,645 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_ssw.yaml' 2026-09-01T00:16:54,646 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_swa.yaml' 2026-09-01T00:16:54,648 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_taq.yaml' 2026-09-01T00:16:54,649 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tir.yaml' 2026-09-01T00:16:54,650 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tso.yaml' 2026-09-01T00:16:54,651 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tum.yaml' 2026-09-01T00:16:54,652 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_twi.yaml' 2026-09-01T00:16:54,653 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_tzm.yaml' 2026-09-01T00:16:54,655 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_umb.yaml' 2026-09-01T00:16:54,656 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_wol.yaml' 2026-09-01T00:16:54,657 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_xho.yaml' 2026-09-01T00:16:54,658 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_yor.yaml' 2026-09-01T00:16:54,660 adding 'lm_eval/tasks/afrobench/sib/prompt_3/sib_zul.yaml' 2026-09-01T00:16:54,661 adding 'lm_eval/tasks/afrobench/sib/prompt_3/utils.py' 2026-09-01T00:16:54,663 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib' 2026-09-01T00:16:54,665 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aeb.yaml' 2026-09-01T00:16:54,666 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_afr.yaml' 2026-09-01T00:16:54,667 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_aka.yaml' 2026-09-01T00:16:54,668 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_amh.yaml' 2026-09-01T00:16:54,669 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ary.yaml' 2026-09-01T00:16:54,670 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_arz.yaml' 2026-09-01T00:16:54,671 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bam.yaml' 2026-09-01T00:16:54,672 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_bem.yaml' 2026-09-01T00:16:54,674 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_cjk.yaml' 2026-09-01T00:16:54,675 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dik.yaml' 2026-09-01T00:16:54,676 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_dyu.yaml' 2026-09-01T00:16:54,677 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_eng.yaml' 2026-09-01T00:16:54,678 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ewe.yaml' 2026-09-01T00:16:54,680 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fon.yaml' 2026-09-01T00:16:54,681 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fra.yaml' 2026-09-01T00:16:54,682 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_fuv.yaml' 2026-09-01T00:16:54,683 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_gaz.yaml' 2026-09-01T00:16:54,684 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_hau.yaml' 2026-09-01T00:16:54,685 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ibo.yaml' 2026-09-01T00:16:54,686 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kab.yaml' 2026-09-01T00:16:54,688 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kam.yaml' 2026-09-01T00:16:54,689 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kbp.yaml' 2026-09-01T00:16:54,690 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kea.yaml' 2026-09-01T00:16:54,691 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kik.yaml' 2026-09-01T00:16:54,693 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kin.yaml' 2026-09-01T00:16:54,694 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kmb.yaml' 2026-09-01T00:16:54,695 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_knc.yaml' 2026-09-01T00:16:54,696 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_kon.yaml' 2026-09-01T00:16:54,697 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lin.yaml' 2026-09-01T00:16:54,698 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lua.yaml' 2026-09-01T00:16:54,700 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_lug.yaml' 2026-09-01T00:16:54,701 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_luo.yaml' 2026-09-01T00:16:54,702 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_mos.yaml' 2026-09-01T00:16:54,703 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nso.yaml' 2026-09-01T00:16:54,704 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nus.yaml' 2026-09-01T00:16:54,705 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_nya.yaml' 2026-09-01T00:16:54,707 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_plt.yaml' 2026-09-01T00:16:54,708 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_por.yaml' 2026-09-01T00:16:54,709 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_run.yaml' 2026-09-01T00:16:54,710 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sag.yaml' 2026-09-01T00:16:54,711 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sna.yaml' 2026-09-01T00:16:54,712 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_som.yaml' 2026-09-01T00:16:54,714 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_sot.yaml' 2026-09-01T00:16:54,715 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_ssw.yaml' 2026-09-01T00:16:54,716 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_swa.yaml' 2026-09-01T00:16:54,717 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_taq.yaml' 2026-09-01T00:16:54,718 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tir.yaml' 2026-09-01T00:16:54,719 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tso.yaml' 2026-09-01T00:16:54,721 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tum.yaml' 2026-09-01T00:16:54,722 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_twi.yaml' 2026-09-01T00:16:54,723 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_tzm.yaml' 2026-09-01T00:16:54,724 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_umb.yaml' 2026-09-01T00:16:54,725 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_wol.yaml' 2026-09-01T00:16:54,726 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_xho.yaml' 2026-09-01T00:16:54,727 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_yor.yaml' 2026-09-01T00:16:54,728 adding 'lm_eval/tasks/afrobench/sib/prompt_4/sib_zul.yaml' 2026-09-01T00:16:54,729 adding 'lm_eval/tasks/afrobench/sib/prompt_4/utils.py' 2026-09-01T00:16:54,732 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib' 2026-09-01T00:16:54,733 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aeb.yaml' 2026-09-01T00:16:54,735 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_afr.yaml' 2026-09-01T00:16:54,736 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_aka.yaml' 2026-09-01T00:16:54,737 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_amh.yaml' 2026-09-01T00:16:54,738 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ary.yaml' 2026-09-01T00:16:54,740 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_arz.yaml' 2026-09-01T00:16:54,741 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bam.yaml' 2026-09-01T00:16:54,742 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_bem.yaml' 2026-09-01T00:16:54,743 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_cjk.yaml' 2026-09-01T00:16:54,745 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dik.yaml' 2026-09-01T00:16:54,746 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_dyu.yaml' 2026-09-01T00:16:54,747 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_eng.yaml' 2026-09-01T00:16:54,748 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ewe.yaml' 2026-09-01T00:16:54,749 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fon.yaml' 2026-09-01T00:16:54,751 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fra.yaml' 2026-09-01T00:16:54,752 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_fuv.yaml' 2026-09-01T00:16:54,753 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_gaz.yaml' 2026-09-01T00:16:54,754 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_hau.yaml' 2026-09-01T00:16:54,756 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ibo.yaml' 2026-09-01T00:16:54,757 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kab.yaml' 2026-09-01T00:16:54,758 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kam.yaml' 2026-09-01T00:16:54,760 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kbp.yaml' 2026-09-01T00:16:54,761 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kea.yaml' 2026-09-01T00:16:54,762 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kik.yaml' 2026-09-01T00:16:54,763 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kin.yaml' 2026-09-01T00:16:54,765 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kmb.yaml' 2026-09-01T00:16:54,766 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_knc.yaml' 2026-09-01T00:16:54,767 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_kon.yaml' 2026-09-01T00:16:54,768 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lin.yaml' 2026-09-01T00:16:54,770 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lua.yaml' 2026-09-01T00:16:54,771 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_lug.yaml' 2026-09-01T00:16:54,772 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_luo.yaml' 2026-09-01T00:16:54,773 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_mos.yaml' 2026-09-01T00:16:54,775 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nso.yaml' 2026-09-01T00:16:54,776 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nus.yaml' 2026-09-01T00:16:54,777 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_nya.yaml' 2026-09-01T00:16:54,779 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_plt.yaml' 2026-09-01T00:16:54,780 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_por.yaml' 2026-09-01T00:16:54,781 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_run.yaml' 2026-09-01T00:16:54,783 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sag.yaml' 2026-09-01T00:16:54,784 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sna.yaml' 2026-09-01T00:16:54,785 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_som.yaml' 2026-09-01T00:16:54,786 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_sot.yaml' 2026-09-01T00:16:54,787 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_ssw.yaml' 2026-09-01T00:16:54,789 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_swa.yaml' 2026-09-01T00:16:54,790 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_taq.yaml' 2026-09-01T00:16:54,791 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tir.yaml' 2026-09-01T00:16:54,792 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tso.yaml' 2026-09-01T00:16:54,793 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tum.yaml' 2026-09-01T00:16:54,795 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_twi.yaml' 2026-09-01T00:16:54,796 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_tzm.yaml' 2026-09-01T00:16:54,797 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_umb.yaml' 2026-09-01T00:16:54,798 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_wol.yaml' 2026-09-01T00:16:54,800 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_xho.yaml' 2026-09-01T00:16:54,801 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_yor.yaml' 2026-09-01T00:16:54,802 adding 'lm_eval/tasks/afrobench/sib/prompt_5/sib_zul.yaml' 2026-09-01T00:16:54,803 adding 'lm_eval/tasks/afrobench/sib/prompt_5/utils.py' 2026-09-01T00:16:54,805 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/README.md' 2026-09-01T00:16:54,806 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/uhura.yaml' 2026-09-01T00:16:54,807 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/utils.py' 2026-09-01T00:16:54,809 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy' 2026-09-01T00:16:54,811 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_am.yaml' 2026-09-01T00:16:54,812 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_en.yaml' 2026-09-01T00:16:54,813 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_ha.yaml' 2026-09-01T00:16:54,814 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_nso.yaml' 2026-09-01T00:16:54,815 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_sw.yaml' 2026-09-01T00:16:54,817 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_yo.yaml' 2026-09-01T00:16:54,818 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/uhura-arc-easy_zu.yaml' 2026-09-01T00:16:54,819 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_1/utils.py' 2026-09-01T00:16:54,821 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy' 2026-09-01T00:16:54,822 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_am.yaml' 2026-09-01T00:16:54,823 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_en.yaml' 2026-09-01T00:16:54,824 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_ha.yaml' 2026-09-01T00:16:54,826 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_nso.yaml' 2026-09-01T00:16:54,827 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_sw.yaml' 2026-09-01T00:16:54,828 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_yo.yaml' 2026-09-01T00:16:54,829 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/uhura-arc-easy_zu.yaml' 2026-09-01T00:16:54,830 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_2/utils.py' 2026-09-01T00:16:54,832 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy' 2026-09-01T00:16:54,834 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_am.yaml' 2026-09-01T00:16:54,835 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_en.yaml' 2026-09-01T00:16:54,836 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_ha.yaml' 2026-09-01T00:16:54,837 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_nso.yaml' 2026-09-01T00:16:54,839 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_sw.yaml' 2026-09-01T00:16:54,840 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_yo.yaml' 2026-09-01T00:16:54,841 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/uhura-arc-easy_zu.yaml' 2026-09-01T00:16:54,842 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_3/utils.py' 2026-09-01T00:16:54,843 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy' 2026-09-01T00:16:54,845 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_am.yaml' 2026-09-01T00:16:54,846 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_en.yaml' 2026-09-01T00:16:54,847 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_ha.yaml' 2026-09-01T00:16:54,848 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_nso.yaml' 2026-09-01T00:16:54,849 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_sw.yaml' 2026-09-01T00:16:54,851 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_yo.yaml' 2026-09-01T00:16:54,852 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/uhura-arc-easy_zu.yaml' 2026-09-01T00:16:54,853 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_4/utils.py' 2026-09-01T00:16:54,855 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy' 2026-09-01T00:16:54,856 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_am.yaml' 2026-09-01T00:16:54,857 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_en.yaml' 2026-09-01T00:16:54,858 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_ha.yaml' 2026-09-01T00:16:54,859 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_nso.yaml' 2026-09-01T00:16:54,861 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_sw.yaml' 2026-09-01T00:16:54,862 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_yo.yaml' 2026-09-01T00:16:54,863 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/uhura-arc-easy_zu.yaml' 2026-09-01T00:16:54,864 adding 'lm_eval/tasks/afrobench/uhura-arc-easy/prompt_5/utils.py' 2026-09-01T00:16:54,866 adding 'lm_eval/tasks/afrobench/xlsum/README.md' 2026-09-01T00:16:54,868 adding 'lm_eval/tasks/afrobench/xlsum/utils.py' 2026-09-01T00:16:54,869 adding 'lm_eval/tasks/afrobench/xlsum/xlsum.yaml' 2026-09-01T00:16:54,870 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/utils.py' 2026-09-01T00:16:54,872 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum' 2026-09-01T00:16:54,873 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_amharic.yaml' 2026-09-01T00:16:54,874 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_arabic.yaml' 2026-09-01T00:16:54,875 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_hausa.yaml' 2026-09-01T00:16:54,877 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_igbo.yaml' 2026-09-01T00:16:54,878 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_kirundi.yaml' 2026-09-01T00:16:54,879 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_oromo.yaml' 2026-09-01T00:16:54,880 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_pidgin.yaml' 2026-09-01T00:16:54,881 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_somali.yaml' 2026-09-01T00:16:54,882 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_swahili.yaml' 2026-09-01T00:16:54,884 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_telugu.yaml' 2026-09-01T00:16:54,885 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_tigrinya.yaml' 2026-09-01T00:16:54,886 adding 'lm_eval/tasks/afrobench/xlsum/prompt_1/xlsum_yoruba.yaml' 2026-09-01T00:16:54,888 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/utils.py' 2026-09-01T00:16:54,889 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum' 2026-09-01T00:16:54,890 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_amharic.yaml' 2026-09-01T00:16:54,891 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_arabic.yaml' 2026-09-01T00:16:54,893 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_hausa.yaml' 2026-09-01T00:16:54,894 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_igbo.yaml' 2026-09-01T00:16:54,895 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_kirundi.yaml' 2026-09-01T00:16:54,896 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_oromo.yaml' 2026-09-01T00:16:54,897 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_pidgin.yaml' 2026-09-01T00:16:54,898 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_somali.yaml' 2026-09-01T00:16:54,899 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_swahili.yaml' 2026-09-01T00:16:54,900 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_telugu.yaml' 2026-09-01T00:16:54,901 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_tigrinya.yaml' 2026-09-01T00:16:54,902 adding 'lm_eval/tasks/afrobench/xlsum/prompt_2/xlsum_yoruba.yaml' 2026-09-01T00:16:54,904 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/utils.py' 2026-09-01T00:16:54,905 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum' 2026-09-01T00:16:54,907 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_amharic.yaml' 2026-09-01T00:16:54,908 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_arabic.yaml' 2026-09-01T00:16:54,909 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_hausa.yaml' 2026-09-01T00:16:54,910 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_igbo.yaml' 2026-09-01T00:16:54,911 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_kirundi.yaml' 2026-09-01T00:16:54,912 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_oromo.yaml' 2026-09-01T00:16:54,913 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_pidgin.yaml' 2026-09-01T00:16:54,915 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_somali.yaml' 2026-09-01T00:16:54,916 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_swahili.yaml' 2026-09-01T00:16:54,917 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_telugu.yaml' 2026-09-01T00:16:54,918 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_tigrinya.yaml' 2026-09-01T00:16:54,919 adding 'lm_eval/tasks/afrobench/xlsum/prompt_3/xlsum_yoruba.yaml' 2026-09-01T00:16:54,922 adding 'lm_eval/tasks/agieval/README.md' 2026-09-01T00:16:54,923 adding 'lm_eval/tasks/agieval/agieval.yaml' 2026-09-01T00:16:54,924 adding 'lm_eval/tasks/agieval/agieval_cn.yaml' 2026-09-01T00:16:54,926 adding 'lm_eval/tasks/agieval/agieval_en.yaml' 2026-09-01T00:16:54,927 adding 'lm_eval/tasks/agieval/agieval_nous.yaml' 2026-09-01T00:16:54,928 adding 'lm_eval/tasks/agieval/aqua-rat.yaml' 2026-09-01T00:16:54,929 adding 'lm_eval/tasks/agieval/gaokao-biology.yaml' 2026-09-01T00:16:54,930 adding 'lm_eval/tasks/agieval/gaokao-chemistry.yaml' 2026-09-01T00:16:54,931 adding 'lm_eval/tasks/agieval/gaokao-chinese.yaml' 2026-09-01T00:16:54,932 adding 'lm_eval/tasks/agieval/gaokao-english.yaml' 2026-09-01T00:16:54,934 adding 'lm_eval/tasks/agieval/gaokao-geography.yaml' 2026-09-01T00:16:54,935 adding 'lm_eval/tasks/agieval/gaokao-history.yaml' 2026-09-01T00:16:54,936 adding 'lm_eval/tasks/agieval/gaokao-mathcloze.yaml' 2026-09-01T00:16:54,937 adding 'lm_eval/tasks/agieval/gaokao-mathqa.yaml' 2026-09-01T00:16:54,938 adding 'lm_eval/tasks/agieval/gaokao-physics.yaml' 2026-09-01T00:16:54,939 adding 'lm_eval/tasks/agieval/jec-qa-ca.yaml' 2026-09-01T00:16:54,941 adding 'lm_eval/tasks/agieval/jec-qa-kd.yaml' 2026-09-01T00:16:54,942 adding 'lm_eval/tasks/agieval/logiqa-en.yaml' 2026-09-01T00:16:54,943 adding 'lm_eval/tasks/agieval/logiqa-zh.yaml' 2026-09-01T00:16:54,944 adding 'lm_eval/tasks/agieval/lsat-ar.yaml' 2026-09-01T00:16:54,945 adding 'lm_eval/tasks/agieval/lsat-lr.yaml' 2026-09-01T00:16:54,946 adding 'lm_eval/tasks/agieval/lsat-rc.yaml' 2026-09-01T00:16:54,948 adding 'lm_eval/tasks/agieval/math.yaml' 2026-09-01T00:16:54,949 adding 'lm_eval/tasks/agieval/sat-en-without-passage.yaml' 2026-09-01T00:16:54,950 adding 'lm_eval/tasks/agieval/sat-en.yaml' 2026-09-01T00:16:54,951 adding 'lm_eval/tasks/agieval/sat-math.yaml' 2026-09-01T00:16:54,952 adding 'lm_eval/tasks/agieval/utils.py' 2026-09-01T00:16:54,954 adding 'lm_eval/tasks/aime/README.md' 2026-09-01T00:16:54,955 adding 'lm_eval/tasks/aime/aime.yaml' 2026-09-01T00:16:54,957 adding 'lm_eval/tasks/aime/aime24.yaml' 2026-09-01T00:16:54,958 adding 'lm_eval/tasks/aime/aime25.yaml' 2026-09-01T00:16:54,959 adding 'lm_eval/tasks/aime/utils.py' 2026-09-01T00:16:54,961 adding 'lm_eval/tasks/alghafa/copa_ar/README.md' 2026-09-01T00:16:54,963 adding 'lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml' 2026-09-01T00:16:54,964 adding 'lm_eval/tasks/alghafa/piqa_ar/README.md' 2026-09-01T00:16:54,965 adding 'lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml' 2026-09-01T00:16:54,967 adding 'lm_eval/tasks/anli/README.md' 2026-09-01T00:16:54,969 adding 'lm_eval/tasks/anli/anli_r1.yaml' 2026-09-01T00:16:54,970 adding 'lm_eval/tasks/anli/anli_r2.yaml' 2026-09-01T00:16:54,971 adding 'lm_eval/tasks/anli/anli_r3.yaml' 2026-09-01T00:16:54,973 adding 'lm_eval/tasks/arab_culture/README.md' 2026-09-01T00:16:54,974 adding 'lm_eval/tasks/arab_culture/_arab_culture.yaml' 2026-09-01T00:16:54,975 adding 'lm_eval/tasks/arab_culture/_arab_culture_gulf.yaml' 2026-09-01T00:16:54,976 adding 'lm_eval/tasks/arab_culture/_arab_culture_levant.yaml' 2026-09-01T00:16:54,978 adding 'lm_eval/tasks/arab_culture/_arab_culture_nile_valley.yaml' 2026-09-01T00:16:54,979 adding 'lm_eval/tasks/arab_culture/_arab_culture_north_africa.yaml' 2026-09-01T00:16:54,980 adding 'lm_eval/tasks/arab_culture/_default_arab_culture_mcq_template_yaml' 2026-09-01T00:16:54,981 adding 'lm_eval/tasks/arab_culture/_generate_configs.py' 2026-09-01T00:16:54,982 adding 'lm_eval/tasks/arab_culture/arab_culture_algeria.yaml' 2026-09-01T00:16:54,983 adding 'lm_eval/tasks/arab_culture/arab_culture_egypt.yaml' 2026-09-01T00:16:54,984 adding 'lm_eval/tasks/arab_culture/arab_culture_jordan.yaml' 2026-09-01T00:16:54,986 adding 'lm_eval/tasks/arab_culture/arab_culture_ksa.yaml' 2026-09-01T00:16:54,987 adding 'lm_eval/tasks/arab_culture/arab_culture_lebanon.yaml' 2026-09-01T00:16:54,988 adding 'lm_eval/tasks/arab_culture/arab_culture_libya.yaml' 2026-09-01T00:16:54,989 adding 'lm_eval/tasks/arab_culture/arab_culture_morocco.yaml' 2026-09-01T00:16:54,990 adding 'lm_eval/tasks/arab_culture/arab_culture_palestine.yaml' 2026-09-01T00:16:54,991 adding 'lm_eval/tasks/arab_culture/arab_culture_sudan.yaml' 2026-09-01T00:16:54,993 adding 'lm_eval/tasks/arab_culture/arab_culture_syria.yaml' 2026-09-01T00:16:54,994 adding 'lm_eval/tasks/arab_culture/arab_culture_tunisia.yaml' 2026-09-01T00:16:54,995 adding 'lm_eval/tasks/arab_culture/arab_culture_uae.yaml' 2026-09-01T00:16:54,996 adding 'lm_eval/tasks/arab_culture/arab_culture_yemen.yaml' 2026-09-01T00:16:54,998 adding 'lm_eval/tasks/arab_culture/prompts.py' 2026-09-01T00:16:54,999 adding 'lm_eval/tasks/arab_culture/utils_mcq.py' 2026-09-01T00:16:55,002 adding 'lm_eval/tasks/arab_culture_completion/README.md' 2026-09-01T00:16:55,003 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion.yaml' 2026-09-01T00:16:55,004 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_gulf.yaml' 2026-09-01T00:16:55,006 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_levant.yaml' 2026-09-01T00:16:55,007 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_nile_valley.yaml' 2026-09-01T00:16:55,008 adding 'lm_eval/tasks/arab_culture_completion/_arab_culture_completion_north_africa.yaml' 2026-09-01T00:16:55,009 adding 'lm_eval/tasks/arab_culture_completion/_default_arab_culture_completion_template_yaml' 2026-09-01T00:16:55,010 adding 'lm_eval/tasks/arab_culture_completion/_generate_configs.py' 2026-09-01T00:16:55,012 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_algeria.yaml' 2026-09-01T00:16:55,013 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_egypt.yaml' 2026-09-01T00:16:55,014 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_jordan.yaml' 2026-09-01T00:16:55,015 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_ksa.yaml' 2026-09-01T00:16:55,016 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_lebanon.yaml' 2026-09-01T00:16:55,017 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_libya.yaml' 2026-09-01T00:16:55,018 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_morocco.yaml' 2026-09-01T00:16:55,019 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_palestine.yaml' 2026-09-01T00:16:55,020 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_sudan.yaml' 2026-09-01T00:16:55,021 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_syria.yaml' 2026-09-01T00:16:55,023 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_tunisia.yaml' 2026-09-01T00:16:55,024 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_uae.yaml' 2026-09-01T00:16:55,025 adding 'lm_eval/tasks/arab_culture_completion/arab_culture_completion_yemen.yaml' 2026-09-01T00:16:55,027 adding 'lm_eval/tasks/arab_culture_completion/prompts.py' 2026-09-01T00:16:55,028 adding 'lm_eval/tasks/arab_culture_completion/utils_completion.py' 2026-09-01T00:16:55,031 adding 'lm_eval/tasks/arabic_leaderboard_complete/README.md' 2026-09-01T00:16:55,032 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml' 2026-09-01T00:16:55,034 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml' 2026-09-01T00:16:55,035 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml' 2026-09-01T00:16:55,036 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml' 2026-09-01T00:16:55,038 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml' 2026-09-01T00:16:55,039 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml' 2026-09-01T00:16:55,040 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml' 2026-09-01T00:16:55,041 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml' 2026-09-01T00:16:55,042 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml' 2026-09-01T00:16:55,044 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml' 2026-09-01T00:16:55,045 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml' 2026-09-01T00:16:55,046 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py' 2026-09-01T00:16:55,048 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml' 2026-09-01T00:16:55,049 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml' 2026-09-01T00:16:55,051 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py' 2026-09-01T00:16:55,054 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml' 2026-09-01T00:16:55,055 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml' 2026-09-01T00:16:55,056 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml' 2026-09-01T00:16:55,058 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml' 2026-09-01T00:16:55,059 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml' 2026-09-01T00:16:55,060 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml' 2026-09-01T00:16:55,061 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml' 2026-09-01T00:16:55,062 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml' 2026-09-01T00:16:55,063 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml' 2026-09-01T00:16:55,065 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml' 2026-09-01T00:16:55,066 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml' 2026-09-01T00:16:55,067 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml' 2026-09-01T00:16:55,068 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml' 2026-09-01T00:16:55,069 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml' 2026-09-01T00:16:55,071 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml' 2026-09-01T00:16:55,072 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml' 2026-09-01T00:16:55,073 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml' 2026-09-01T00:16:55,074 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml' 2026-09-01T00:16:55,075 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml' 2026-09-01T00:16:55,077 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml' 2026-09-01T00:16:55,078 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml' 2026-09-01T00:16:55,079 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml' 2026-09-01T00:16:55,080 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml' 2026-09-01T00:16:55,081 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml' 2026-09-01T00:16:55,083 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:16:55,084 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:16:55,085 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml' 2026-09-01T00:16:55,086 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml' 2026-09-01T00:16:55,088 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml' 2026-09-01T00:16:55,089 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml' 2026-09-01T00:16:55,090 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml' 2026-09-01T00:16:55,091 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml' 2026-09-01T00:16:55,092 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml' 2026-09-01T00:16:55,093 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml' 2026-09-01T00:16:55,095 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml' 2026-09-01T00:16:55,096 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml' 2026-09-01T00:16:55,097 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml' 2026-09-01T00:16:55,098 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml' 2026-09-01T00:16:55,099 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml' 2026-09-01T00:16:55,101 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml' 2026-09-01T00:16:55,102 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml' 2026-09-01T00:16:55,103 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml' 2026-09-01T00:16:55,104 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml' 2026-09-01T00:16:55,105 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml' 2026-09-01T00:16:55,107 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml' 2026-09-01T00:16:55,108 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml' 2026-09-01T00:16:55,109 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml' 2026-09-01T00:16:55,110 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml' 2026-09-01T00:16:55,111 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml' 2026-09-01T00:16:55,113 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml' 2026-09-01T00:16:55,114 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml' 2026-09-01T00:16:55,115 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml' 2026-09-01T00:16:55,117 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml' 2026-09-01T00:16:55,118 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml' 2026-09-01T00:16:55,119 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml' 2026-09-01T00:16:55,120 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml' 2026-09-01T00:16:55,121 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml' 2026-09-01T00:16:55,122 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml' 2026-09-01T00:16:55,124 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py' 2026-09-01T00:16:55,125 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml' 2026-09-01T00:16:55,127 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml' 2026-09-01T00:16:55,128 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py' 2026-09-01T00:16:55,129 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml' 2026-09-01T00:16:55,131 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml' 2026-09-01T00:16:55,132 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py' 2026-09-01T00:16:55,133 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml' 2026-09-01T00:16:55,135 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml' 2026-09-01T00:16:55,136 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py' 2026-09-01T00:16:55,138 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml' 2026-09-01T00:16:55,139 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml' 2026-09-01T00:16:55,140 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py' 2026-09-01T00:16:55,142 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml' 2026-09-01T00:16:55,145 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml' 2026-09-01T00:16:55,147 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py' 2026-09-01T00:16:55,148 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml' 2026-09-01T00:16:55,150 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml' 2026-09-01T00:16:55,151 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py' 2026-09-01T00:16:55,153 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml' 2026-09-01T00:16:55,154 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml' 2026-09-01T00:16:55,155 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py' 2026-09-01T00:16:55,157 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml' 2026-09-01T00:16:55,158 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml' 2026-09-01T00:16:55,159 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py' 2026-09-01T00:16:55,161 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml' 2026-09-01T00:16:55,162 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml' 2026-09-01T00:16:55,163 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py' 2026-09-01T00:16:55,165 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml' 2026-09-01T00:16:55,166 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml' 2026-09-01T00:16:55,167 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py' 2026-09-01T00:16:55,169 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml' 2026-09-01T00:16:55,170 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml' 2026-09-01T00:16:55,172 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py' 2026-09-01T00:16:55,174 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml' 2026-09-01T00:16:55,176 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml' 2026-09-01T00:16:55,177 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml' 2026-09-01T00:16:55,178 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml' 2026-09-01T00:16:55,179 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml' 2026-09-01T00:16:55,180 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml' 2026-09-01T00:16:55,182 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml' 2026-09-01T00:16:55,183 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml' 2026-09-01T00:16:55,184 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml' 2026-09-01T00:16:55,185 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml' 2026-09-01T00:16:55,186 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml' 2026-09-01T00:16:55,188 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml' 2026-09-01T00:16:55,189 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml' 2026-09-01T00:16:55,190 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml' 2026-09-01T00:16:55,191 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml' 2026-09-01T00:16:55,192 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml' 2026-09-01T00:16:55,194 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml' 2026-09-01T00:16:55,195 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml' 2026-09-01T00:16:55,196 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml' 2026-09-01T00:16:55,197 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml' 2026-09-01T00:16:55,199 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml' 2026-09-01T00:16:55,200 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml' 2026-09-01T00:16:55,201 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml' 2026-09-01T00:16:55,202 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml' 2026-09-01T00:16:55,203 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml' 2026-09-01T00:16:55,204 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml' 2026-09-01T00:16:55,206 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml' 2026-09-01T00:16:55,207 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml' 2026-09-01T00:16:55,208 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml' 2026-09-01T00:16:55,209 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml' 2026-09-01T00:16:55,210 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml' 2026-09-01T00:16:55,212 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml' 2026-09-01T00:16:55,213 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml' 2026-09-01T00:16:55,214 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml' 2026-09-01T00:16:55,215 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml' 2026-09-01T00:16:55,216 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml' 2026-09-01T00:16:55,218 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml' 2026-09-01T00:16:55,219 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml' 2026-09-01T00:16:55,220 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml' 2026-09-01T00:16:55,221 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml' 2026-09-01T00:16:55,222 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml' 2026-09-01T00:16:55,224 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml' 2026-09-01T00:16:55,225 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml' 2026-09-01T00:16:55,226 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml' 2026-09-01T00:16:55,227 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml' 2026-09-01T00:16:55,229 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml' 2026-09-01T00:16:55,230 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml' 2026-09-01T00:16:55,231 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml' 2026-09-01T00:16:55,232 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml' 2026-09-01T00:16:55,233 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml' 2026-09-01T00:16:55,235 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml' 2026-09-01T00:16:55,236 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml' 2026-09-01T00:16:55,237 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml' 2026-09-01T00:16:55,238 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml' 2026-09-01T00:16:55,239 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml' 2026-09-01T00:16:55,240 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml' 2026-09-01T00:16:55,241 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml' 2026-09-01T00:16:55,243 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml' 2026-09-01T00:16:55,244 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml' 2026-09-01T00:16:55,245 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py' 2026-09-01T00:16:55,247 adding 'lm_eval/tasks/arabic_leaderboard_light/README.md' 2026-09-01T00:16:55,248 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml' 2026-09-01T00:16:55,250 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml' 2026-09-01T00:16:55,251 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml' 2026-09-01T00:16:55,252 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml' 2026-09-01T00:16:55,254 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml' 2026-09-01T00:16:55,255 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml' 2026-09-01T00:16:55,256 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml' 2026-09-01T00:16:55,257 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml' 2026-09-01T00:16:55,259 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml' 2026-09-01T00:16:55,260 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml' 2026-09-01T00:16:55,261 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml' 2026-09-01T00:16:55,262 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py' 2026-09-01T00:16:55,264 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml' 2026-09-01T00:16:55,265 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml' 2026-09-01T00:16:55,267 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py' 2026-09-01T00:16:55,269 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml' 2026-09-01T00:16:55,270 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml' 2026-09-01T00:16:55,272 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml' 2026-09-01T00:16:55,273 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml' 2026-09-01T00:16:55,274 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml' 2026-09-01T00:16:55,275 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml' 2026-09-01T00:16:55,276 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml' 2026-09-01T00:16:55,277 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml' 2026-09-01T00:16:55,279 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml' 2026-09-01T00:16:55,280 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml' 2026-09-01T00:16:55,281 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml' 2026-09-01T00:16:55,282 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml' 2026-09-01T00:16:55,283 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml' 2026-09-01T00:16:55,284 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml' 2026-09-01T00:16:55,286 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml' 2026-09-01T00:16:55,287 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml' 2026-09-01T00:16:55,288 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml' 2026-09-01T00:16:55,289 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml' 2026-09-01T00:16:55,291 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml' 2026-09-01T00:16:55,292 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml' 2026-09-01T00:16:55,293 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml' 2026-09-01T00:16:55,294 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml' 2026-09-01T00:16:55,296 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml' 2026-09-01T00:16:55,297 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml' 2026-09-01T00:16:55,298 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml' 2026-09-01T00:16:55,299 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml' 2026-09-01T00:16:55,300 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml' 2026-09-01T00:16:55,301 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml' 2026-09-01T00:16:55,303 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml' 2026-09-01T00:16:55,304 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml' 2026-09-01T00:16:55,305 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml' 2026-09-01T00:16:55,306 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml' 2026-09-01T00:16:55,307 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml' 2026-09-01T00:16:55,309 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml' 2026-09-01T00:16:55,310 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml' 2026-09-01T00:16:55,311 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml' 2026-09-01T00:16:55,312 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml' 2026-09-01T00:16:55,314 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml' 2026-09-01T00:16:55,315 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml' 2026-09-01T00:16:55,316 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml' 2026-09-01T00:16:55,317 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml' 2026-09-01T00:16:55,318 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml' 2026-09-01T00:16:55,320 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml' 2026-09-01T00:16:55,321 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml' 2026-09-01T00:16:55,322 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml' 2026-09-01T00:16:55,323 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml' 2026-09-01T00:16:55,325 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml' 2026-09-01T00:16:55,326 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml' 2026-09-01T00:16:55,327 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml' 2026-09-01T00:16:55,328 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml' 2026-09-01T00:16:55,330 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml' 2026-09-01T00:16:55,331 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml' 2026-09-01T00:16:55,332 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml' 2026-09-01T00:16:55,333 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml' 2026-09-01T00:16:55,334 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml' 2026-09-01T00:16:55,336 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml' 2026-09-01T00:16:55,337 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml' 2026-09-01T00:16:55,338 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml' 2026-09-01T00:16:55,339 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py' 2026-09-01T00:16:55,341 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml' 2026-09-01T00:16:55,342 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml' 2026-09-01T00:16:55,344 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py' 2026-09-01T00:16:55,346 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml' 2026-09-01T00:16:55,347 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml' 2026-09-01T00:16:55,348 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py' 2026-09-01T00:16:55,350 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml' 2026-09-01T00:16:55,351 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml' 2026-09-01T00:16:55,352 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py' 2026-09-01T00:16:55,354 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml' 2026-09-01T00:16:55,355 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml' 2026-09-01T00:16:55,357 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py' 2026-09-01T00:16:55,358 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml' 2026-09-01T00:16:55,360 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml' 2026-09-01T00:16:55,361 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py' 2026-09-01T00:16:55,363 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml' 2026-09-01T00:16:55,364 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml' 2026-09-01T00:16:55,365 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py' 2026-09-01T00:16:55,367 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml' 2026-09-01T00:16:55,368 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml' 2026-09-01T00:16:55,369 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py' 2026-09-01T00:16:55,371 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml' 2026-09-01T00:16:55,372 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml' 2026-09-01T00:16:55,373 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py' 2026-09-01T00:16:55,375 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml' 2026-09-01T00:16:55,376 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml' 2026-09-01T00:16:55,377 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py' 2026-09-01T00:16:55,379 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml' 2026-09-01T00:16:55,380 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml' 2026-09-01T00:16:55,381 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py' 2026-09-01T00:16:55,383 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml' 2026-09-01T00:16:55,384 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml' 2026-09-01T00:16:55,386 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py' 2026-09-01T00:16:55,389 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml' 2026-09-01T00:16:55,390 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml' 2026-09-01T00:16:55,391 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml' 2026-09-01T00:16:55,392 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml' 2026-09-01T00:16:55,394 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml' 2026-09-01T00:16:55,395 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml' 2026-09-01T00:16:55,396 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml' 2026-09-01T00:16:55,397 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml' 2026-09-01T00:16:55,399 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml' 2026-09-01T00:16:55,400 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml' 2026-09-01T00:16:55,401 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml' 2026-09-01T00:16:55,402 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml' 2026-09-01T00:16:55,403 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml' 2026-09-01T00:16:55,404 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml' 2026-09-01T00:16:55,406 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml' 2026-09-01T00:16:55,407 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml' 2026-09-01T00:16:55,408 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml' 2026-09-01T00:16:55,409 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml' 2026-09-01T00:16:55,410 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml' 2026-09-01T00:16:55,411 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml' 2026-09-01T00:16:55,413 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml' 2026-09-01T00:16:55,414 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml' 2026-09-01T00:16:55,415 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml' 2026-09-01T00:16:55,416 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml' 2026-09-01T00:16:55,417 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml' 2026-09-01T00:16:55,419 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml' 2026-09-01T00:16:55,420 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml' 2026-09-01T00:16:55,421 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml' 2026-09-01T00:16:55,422 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml' 2026-09-01T00:16:55,423 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml' 2026-09-01T00:16:55,425 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml' 2026-09-01T00:16:55,426 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml' 2026-09-01T00:16:55,427 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml' 2026-09-01T00:16:55,428 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml' 2026-09-01T00:16:55,430 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml' 2026-09-01T00:16:55,431 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml' 2026-09-01T00:16:55,432 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml' 2026-09-01T00:16:55,433 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml' 2026-09-01T00:16:55,434 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml' 2026-09-01T00:16:55,435 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml' 2026-09-01T00:16:55,436 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml' 2026-09-01T00:16:55,438 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml' 2026-09-01T00:16:55,439 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml' 2026-09-01T00:16:55,440 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml' 2026-09-01T00:16:55,441 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml' 2026-09-01T00:16:55,443 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml' 2026-09-01T00:16:55,444 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml' 2026-09-01T00:16:55,445 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml' 2026-09-01T00:16:55,446 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml' 2026-09-01T00:16:55,447 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml' 2026-09-01T00:16:55,448 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml' 2026-09-01T00:16:55,450 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml' 2026-09-01T00:16:55,451 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml' 2026-09-01T00:16:55,452 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml' 2026-09-01T00:16:55,453 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml' 2026-09-01T00:16:55,454 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml' 2026-09-01T00:16:55,456 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml' 2026-09-01T00:16:55,457 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml' 2026-09-01T00:16:55,458 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml' 2026-09-01T00:16:55,459 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py' 2026-09-01T00:16:55,462 adding 'lm_eval/tasks/arabicmmlu/README.md' 2026-09-01T00:16:55,464 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml' 2026-09-01T00:16:55,465 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml' 2026-09-01T00:16:55,466 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml' 2026-09-01T00:16:55,467 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml' 2026-09-01T00:16:55,468 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml' 2026-09-01T00:16:55,469 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml' 2026-09-01T00:16:55,470 adding 'lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml' 2026-09-01T00:16:55,472 adding 'lm_eval/tasks/arabicmmlu/_generate_configs.py' 2026-09-01T00:16:55,473 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_accounting_university.yaml' 2026-09-01T00:16:55,474 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml' 2026-09-01T00:16:55,475 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml' 2026-09-01T00:16:55,477 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_high_school.yaml' 2026-09-01T00:16:55,478 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_middle_school.yaml' 2026-09-01T00:16:55,479 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_primary_school.yaml' 2026-09-01T00:16:55,480 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_biology_high_school.yaml' 2026-09-01T00:16:55,481 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_high_school.yaml' 2026-09-01T00:16:55,483 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_civics_middle_school.yaml' 2026-09-01T00:16:55,484 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_high_school.yaml' 2026-09-01T00:16:55,485 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_middle_school.yaml' 2026-09-01T00:16:55,486 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_primary_school.yaml' 2026-09-01T00:16:55,487 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_computer_science_university.yaml' 2026-09-01T00:16:55,488 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml' 2026-09-01T00:16:55,489 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_high_school.yaml' 2026-09-01T00:16:55,490 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_middle_school.yaml' 2026-09-01T00:16:55,491 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_economics_university.yaml' 2026-09-01T00:16:55,493 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml' 2026-09-01T00:16:55,494 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_middle_school.yaml' 2026-09-01T00:16:55,495 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge_primary_school.yaml' 2026-09-01T00:16:55,496 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_high_school.yaml' 2026-09-01T00:16:55,497 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_middle_school.yaml' 2026-09-01T00:16:55,498 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_geography_primary_school.yaml' 2026-09-01T00:16:55,500 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_high_school.yaml' 2026-09-01T00:16:55,501 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_middle_school.yaml' 2026-09-01T00:16:55,502 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_history_primary_school.yaml' 2026-09-01T00:16:55,503 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml' 2026-09-01T00:16:55,504 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_high_school.yaml' 2026-09-01T00:16:55,505 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_middle_school.yaml' 2026-09-01T00:16:55,507 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies_primary_school.yaml' 2026-09-01T00:16:55,508 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_law_professional.yaml' 2026-09-01T00:16:55,509 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_management_university.yaml' 2026-09-01T00:16:55,510 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_math_primary_school.yaml' 2026-09-01T00:16:55,511 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_middle_school.yaml' 2026-09-01T00:16:55,512 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_natural_science_primary_school.yaml' 2026-09-01T00:16:55,514 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_philosophy_high_school.yaml' 2026-09-01T00:16:55,515 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_physics_high_school.yaml' 2026-09-01T00:16:55,516 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_political_science_university.yaml' 2026-09-01T00:16:55,517 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_middle_school.yaml' 2026-09-01T00:16:55,518 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_social_science_primary_school.yaml' 2026-09-01T00:16:55,519 adding 'lm_eval/tasks/arabicmmlu/utils.py' 2026-09-01T00:16:55,521 adding 'lm_eval/tasks/aradice/README.md' 2026-09-01T00:16:55,523 adding 'lm_eval/tasks/aradice/aradice.yaml' 2026-09-01T00:16:55,526 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU.yaml' 2026-09-01T00:16:55,527 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2026-09-01T00:16:55,528 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,529 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2026-09-01T00:16:55,530 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2026-09-01T00:16:55,532 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2026-09-01T00:16:55,533 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2026-09-01T00:16:55,534 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2026-09-01T00:16:55,535 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2026-09-01T00:16:55,536 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2026-09-01T00:16:55,537 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2026-09-01T00:16:55,538 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2026-09-01T00:16:55,540 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,541 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2026-09-01T00:16:55,542 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2026-09-01T00:16:55,543 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2026-09-01T00:16:55,545 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2026-09-01T00:16:55,546 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2026-09-01T00:16:55,547 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2026-09-01T00:16:55,548 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2026-09-01T00:16:55,549 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2026-09-01T00:16:55,551 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,552 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2026-09-01T00:16:55,553 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2026-09-01T00:16:55,554 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2026-09-01T00:16:55,555 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2026-09-01T00:16:55,557 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2026-09-01T00:16:55,558 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,559 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2026-09-01T00:16:55,560 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2026-09-01T00:16:55,561 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2026-09-01T00:16:55,562 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2026-09-01T00:16:55,563 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2026-09-01T00:16:55,564 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2026-09-01T00:16:55,566 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2026-09-01T00:16:55,567 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2026-09-01T00:16:55,568 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2026-09-01T00:16:55,569 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2026-09-01T00:16:55,570 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2026-09-01T00:16:55,571 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2026-09-01T00:16:55,572 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2026-09-01T00:16:55,574 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/_default_template_yaml' 2026-09-01T00:16:55,575 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/metrics.py' 2026-09-01T00:16:55,576 adding 'lm_eval/tasks/aradice/ArabicMMLU/EGY/utils.py' 2026-09-01T00:16:55,579 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU.yaml' 2026-09-01T00:16:55,580 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_history.yaml' 2026-09-01T00:16:55,581 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,582 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_humanities_philosophy.yaml' 2026-09-01T00:16:55,584 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_language_arabic-language.yaml' 2026-09-01T00:16:55,585 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_civics.yaml' 2026-09-01T00:16:55,586 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_economics.yaml' 2026-09-01T00:16:55,587 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_social-science_geography.yaml' 2026-09-01T00:16:55,588 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_biology.yaml' 2026-09-01T00:16:55,589 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_computer-science.yaml' 2026-09-01T00:16:55,591 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_high_stem_physics.yaml' 2026-09-01T00:16:55,592 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_history.yaml' 2026-09-01T00:16:55,593 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,594 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_language_arabic-language.yaml' 2026-09-01T00:16:55,595 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_other_general-knowledge.yaml' 2026-09-01T00:16:55,597 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_civics.yaml' 2026-09-01T00:16:55,598 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_economics.yaml' 2026-09-01T00:16:55,599 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_geography.yaml' 2026-09-01T00:16:55,600 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_social-science_social-science.yaml' 2026-09-01T00:16:55,601 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_computer-science.yaml' 2026-09-01T00:16:55,602 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_middle_stem_natural-science.yaml' 2026-09-01T00:16:55,604 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,605 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-general.yaml' 2026-09-01T00:16:55,606 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_language_arabic-language-grammar.yaml' 2026-09-01T00:16:55,607 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_driving-test.yaml' 2026-09-01T00:16:55,608 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_na_other_general-knowledge.yaml' 2026-09-01T00:16:55,610 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_history.yaml' 2026-09-01T00:16:55,611 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_humanities_islamic-studies.yaml' 2026-09-01T00:16:55,612 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_language_arabic-language.yaml' 2026-09-01T00:16:55,614 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_other_general-knowledge.yaml' 2026-09-01T00:16:55,615 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_geography.yaml' 2026-09-01T00:16:55,616 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_social-science_social-science.yaml' 2026-09-01T00:16:55,617 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_computer-science.yaml' 2026-09-01T00:16:55,618 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_math.yaml' 2026-09-01T00:16:55,619 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_primary_stem_natural-science.yaml' 2026-09-01T00:16:55,620 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_prof_humanities_law.yaml' 2026-09-01T00:16:55,622 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_other_management.yaml' 2026-09-01T00:16:55,623 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_accounting.yaml' 2026-09-01T00:16:55,624 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_economics.yaml' 2026-09-01T00:16:55,625 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_social-science_political-science.yaml' 2026-09-01T00:16:55,626 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/AraDiCE_ArabicMMLU_univ_stem_computer-science.yaml' 2026-09-01T00:16:55,628 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/_default_template_yaml' 2026-09-01T00:16:55,629 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/metrics.py' 2026-09-01T00:16:55,630 adding 'lm_eval/tasks/aradice/ArabicMMLU/LEV/utils.py' 2026-09-01T00:16:55,632 adding 'lm_eval/tasks/aradice/boolq/EGY/boolq_egy.yaml' 2026-09-01T00:16:55,634 adding 'lm_eval/tasks/aradice/boolq/EGY/metrics.py' 2026-09-01T00:16:55,635 adding 'lm_eval/tasks/aradice/boolq/EGY/utils.py' 2026-09-01T00:16:55,637 adding 'lm_eval/tasks/aradice/boolq/ENG/boolq_eng.yaml' 2026-09-01T00:16:55,638 adding 'lm_eval/tasks/aradice/boolq/ENG/metrics.py' 2026-09-01T00:16:55,639 adding 'lm_eval/tasks/aradice/boolq/ENG/utils.py' 2026-09-01T00:16:55,641 adding 'lm_eval/tasks/aradice/boolq/LEV/boolq_lev.yaml' 2026-09-01T00:16:55,642 adding 'lm_eval/tasks/aradice/boolq/LEV/metrics.py' 2026-09-01T00:16:55,643 adding 'lm_eval/tasks/aradice/boolq/LEV/utils.py' 2026-09-01T00:16:55,645 adding 'lm_eval/tasks/aradice/boolq/MSA/boolq_msa.yaml' 2026-09-01T00:16:55,647 adding 'lm_eval/tasks/aradice/boolq/MSA/metrics.py' 2026-09-01T00:16:55,648 adding 'lm_eval/tasks/aradice/boolq/MSA/utils.py' 2026-09-01T00:16:55,650 adding 'lm_eval/tasks/aradice/cultural-benchmark/egypt.yaml' 2026-09-01T00:16:55,651 adding 'lm_eval/tasks/aradice/cultural-benchmark/jordan.yaml' 2026-09-01T00:16:55,652 adding 'lm_eval/tasks/aradice/cultural-benchmark/lebanon.yaml' 2026-09-01T00:16:55,654 adding 'lm_eval/tasks/aradice/cultural-benchmark/metrics.py' 2026-09-01T00:16:55,655 adding 'lm_eval/tasks/aradice/cultural-benchmark/palestine.yaml' 2026-09-01T00:16:55,656 adding 'lm_eval/tasks/aradice/cultural-benchmark/qatar.yaml' 2026-09-01T00:16:55,658 adding 'lm_eval/tasks/aradice/cultural-benchmark/syria.yaml' 2026-09-01T00:16:55,659 adding 'lm_eval/tasks/aradice/cultural-benchmark/utils.py' 2026-09-01T00:16:55,660 adding 'lm_eval/tasks/aradice/openbookqa/metrics.py' 2026-09-01T00:16:55,662 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_egy.yaml' 2026-09-01T00:16:55,663 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_eng.yaml' 2026-09-01T00:16:55,664 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_lev.yaml' 2026-09-01T00:16:55,665 adding 'lm_eval/tasks/aradice/openbookqa/openbookqa_msa.yaml' 2026-09-01T00:16:55,666 adding 'lm_eval/tasks/aradice/openbookqa/utils.py' 2026-09-01T00:16:55,668 adding 'lm_eval/tasks/aradice/piqa/metrics.py' 2026-09-01T00:16:55,670 adding 'lm_eval/tasks/aradice/piqa/piqa_egy.yaml' 2026-09-01T00:16:55,671 adding 'lm_eval/tasks/aradice/piqa/piqa_eng.yaml' 2026-09-01T00:16:55,672 adding 'lm_eval/tasks/aradice/piqa/piqa_lev.yaml' 2026-09-01T00:16:55,673 adding 'lm_eval/tasks/aradice/piqa/piqa_msa.yaml' 2026-09-01T00:16:55,675 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/metrics.py' 2026-09-01T00:16:55,676 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_egy.yaml' 2026-09-01T00:16:55,677 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_eng.yaml' 2026-09-01T00:16:55,678 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_lev.yaml' 2026-09-01T00:16:55,680 adding 'lm_eval/tasks/aradice/truthfulqa_mcq/truthfulqa_mc1_msa.yaml' 2026-09-01T00:16:55,681 adding 'lm_eval/tasks/aradice/winogrande/metrics.py' 2026-09-01T00:16:55,683 adding 'lm_eval/tasks/aradice/winogrande/utils.py' 2026-09-01T00:16:55,684 adding 'lm_eval/tasks/aradice/winogrande/winogrande_egy.yaml' 2026-09-01T00:16:55,685 adding 'lm_eval/tasks/aradice/winogrande/winogrande_eng.yaml' 2026-09-01T00:16:55,686 adding 'lm_eval/tasks/aradice/winogrande/winogrande_lev.yaml' 2026-09-01T00:16:55,688 adding 'lm_eval/tasks/aradice/winogrande/winogrande_msa.yaml' 2026-09-01T00:16:55,690 adding 'lm_eval/tasks/arc/README.md' 2026-09-01T00:16:55,691 adding 'lm_eval/tasks/arc/arc_challenge.yaml' 2026-09-01T00:16:55,693 adding 'lm_eval/tasks/arc/arc_challenge_chat.yaml' 2026-09-01T00:16:55,694 adding 'lm_eval/tasks/arc/arc_easy.yaml' 2026-09-01T00:16:55,696 adding 'lm_eval/tasks/arc_mt/README.md' 2026-09-01T00:16:55,697 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml' 2026-09-01T00:16:55,698 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml' 2026-09-01T00:16:55,700 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml' 2026-09-01T00:16:55,701 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml' 2026-09-01T00:16:55,702 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml' 2026-09-01T00:16:55,703 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml' 2026-09-01T00:16:55,705 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml' 2026-09-01T00:16:55,706 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml' 2026-09-01T00:16:55,707 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml' 2026-09-01T00:16:55,708 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml' 2026-09-01T00:16:55,709 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml' 2026-09-01T00:16:55,710 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml' 2026-09-01T00:16:55,712 adding 'lm_eval/tasks/arithmetic/README.md' 2026-09-01T00:16:55,714 adding 'lm_eval/tasks/arithmetic/arithmetic_1dc.yaml' 2026-09-01T00:16:55,715 adding 'lm_eval/tasks/arithmetic/arithmetic_2da.yaml' 2026-09-01T00:16:55,716 adding 'lm_eval/tasks/arithmetic/arithmetic_2dm.yaml' 2026-09-01T00:16:55,717 adding 'lm_eval/tasks/arithmetic/arithmetic_2ds.yaml' 2026-09-01T00:16:55,718 adding 'lm_eval/tasks/arithmetic/arithmetic_3da.yaml' 2026-09-01T00:16:55,719 adding 'lm_eval/tasks/arithmetic/arithmetic_3ds.yaml' 2026-09-01T00:16:55,720 adding 'lm_eval/tasks/arithmetic/arithmetic_4da.yaml' 2026-09-01T00:16:55,721 adding 'lm_eval/tasks/arithmetic/arithmetic_4ds.yaml' 2026-09-01T00:16:55,722 adding 'lm_eval/tasks/arithmetic/arithmetic_5da.yaml' 2026-09-01T00:16:55,724 adding 'lm_eval/tasks/arithmetic/arithmetic_5ds.yaml' 2026-09-01T00:16:55,725 adding 'lm_eval/tasks/arithmetic/utils.py' 2026-09-01T00:16:55,727 adding 'lm_eval/tasks/asdiv/README.md' 2026-09-01T00:16:55,728 adding 'lm_eval/tasks/asdiv/asdiv-cot-llama.yaml' 2026-09-01T00:16:55,729 adding 'lm_eval/tasks/asdiv/default.yaml' 2026-09-01T00:16:55,731 adding 'lm_eval/tasks/babi/README.md' 2026-09-01T00:16:55,732 adding 'lm_eval/tasks/babi/babi.yaml' 2026-09-01T00:16:55,735 adding 'lm_eval/tasks/babilong/README.md' 2026-09-01T00:16:55,736 adding 'lm_eval/tasks/babilong/_babilong_common_yaml' 2026-09-01T00:16:55,737 adding 'lm_eval/tasks/babilong/babilong.yaml' 2026-09-01T00:16:55,738 adding 'lm_eval/tasks/babilong/babilong_longctx.yaml' 2026-09-01T00:16:55,740 adding 'lm_eval/tasks/babilong/babilong_qa1.yaml' 2026-09-01T00:16:55,741 adding 'lm_eval/tasks/babilong/babilong_qa10.yaml' 2026-09-01T00:16:55,742 adding 'lm_eval/tasks/babilong/babilong_qa11.yaml' 2026-09-01T00:16:55,743 adding 'lm_eval/tasks/babilong/babilong_qa12.yaml' 2026-09-01T00:16:55,744 adding 'lm_eval/tasks/babilong/babilong_qa13.yaml' 2026-09-01T00:16:55,746 adding 'lm_eval/tasks/babilong/babilong_qa14.yaml' 2026-09-01T00:16:55,747 adding 'lm_eval/tasks/babilong/babilong_qa15.yaml' 2026-09-01T00:16:55,748 adding 'lm_eval/tasks/babilong/babilong_qa16.yaml' 2026-09-01T00:16:55,749 adding 'lm_eval/tasks/babilong/babilong_qa17.yaml' 2026-09-01T00:16:55,750 adding 'lm_eval/tasks/babilong/babilong_qa18.yaml' 2026-09-01T00:16:55,752 adding 'lm_eval/tasks/babilong/babilong_qa19.yaml' 2026-09-01T00:16:55,753 adding 'lm_eval/tasks/babilong/babilong_qa2.yaml' 2026-09-01T00:16:55,754 adding 'lm_eval/tasks/babilong/babilong_qa20.yaml' 2026-09-01T00:16:55,755 adding 'lm_eval/tasks/babilong/babilong_qa3.yaml' 2026-09-01T00:16:55,757 adding 'lm_eval/tasks/babilong/babilong_qa4.yaml' 2026-09-01T00:16:55,758 adding 'lm_eval/tasks/babilong/babilong_qa5.yaml' 2026-09-01T00:16:55,759 adding 'lm_eval/tasks/babilong/babilong_qa6.yaml' 2026-09-01T00:16:55,760 adding 'lm_eval/tasks/babilong/babilong_qa7.yaml' 2026-09-01T00:16:55,762 adding 'lm_eval/tasks/babilong/babilong_qa8.yaml' 2026-09-01T00:16:55,763 adding 'lm_eval/tasks/babilong/babilong_qa9.yaml' 2026-09-01T00:16:55,764 adding 'lm_eval/tasks/babilong/common_utils.py' 2026-09-01T00:16:55,766 adding 'lm_eval/tasks/bangla/README.md' 2026-09-01T00:16:55,767 adding 'lm_eval/tasks/bangla/bangla_boolqa.yaml' 2026-09-01T00:16:55,769 adding 'lm_eval/tasks/bangla/bangla_commonsenseqa.yaml' 2026-09-01T00:16:55,770 adding 'lm_eval/tasks/bangla/bangla_mmlu.yaml' 2026-09-01T00:16:55,771 adding 'lm_eval/tasks/bangla/bangla_openbookqa.yaml' 2026-09-01T00:16:55,772 adding 'lm_eval/tasks/bangla/bangla_piqa.yaml' 2026-09-01T00:16:55,774 adding 'lm_eval/tasks/basque_bench/README.md' 2026-09-01T00:16:55,775 adding 'lm_eval/tasks/basque_bench/arc_eu_challenge.yaml' 2026-09-01T00:16:55,777 adding 'lm_eval/tasks/basque_bench/arc_eu_easy.yaml' 2026-09-01T00:16:55,778 adding 'lm_eval/tasks/basque_bench/basque_bench.yaml' 2026-09-01T00:16:55,779 adding 'lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml' 2026-09-01T00:16:55,780 adding 'lm_eval/tasks/basque_bench/mgsm_native_cot_eu.yaml' 2026-09-01T00:16:55,781 adding 'lm_eval/tasks/basque_bench/paws_eu.yaml' 2026-09-01T00:16:55,783 adding 'lm_eval/tasks/basque_bench/piqa_eu.yaml' 2026-09-01T00:16:55,784 adding 'lm_eval/tasks/basque_bench/utils.py' 2026-09-01T00:16:55,785 adding 'lm_eval/tasks/basque_bench/wnli_eu.yaml' 2026-09-01T00:16:55,786 adding 'lm_eval/tasks/basque_bench/xcopa_eu.yaml' 2026-09-01T00:16:55,788 adding 'lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml' 2026-09-01T00:16:55,790 adding 'lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py' 2026-09-01T00:16:55,791 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml' 2026-09-01T00:16:55,792 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml' 2026-09-01T00:16:55,793 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml' 2026-09-01T00:16:55,794 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml' 2026-09-01T00:16:55,795 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml' 2026-09-01T00:16:55,796 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml' 2026-09-01T00:16:55,797 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml' 2026-09-01T00:16:55,798 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml' 2026-09-01T00:16:55,800 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml' 2026-09-01T00:16:55,801 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml' 2026-09-01T00:16:55,802 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml' 2026-09-01T00:16:55,803 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml' 2026-09-01T00:16:55,804 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml' 2026-09-01T00:16:55,805 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml' 2026-09-01T00:16:55,807 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml' 2026-09-01T00:16:55,808 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml' 2026-09-01T00:16:55,809 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml' 2026-09-01T00:16:55,811 adding 'lm_eval/tasks/basqueglue/README.md' 2026-09-01T00:16:55,812 adding 'lm_eval/tasks/basqueglue/bec.yaml' 2026-09-01T00:16:55,813 adding 'lm_eval/tasks/basqueglue/bhtc.yaml' 2026-09-01T00:16:55,814 adding 'lm_eval/tasks/basqueglue/coref.yaml' 2026-09-01T00:16:55,816 adding 'lm_eval/tasks/basqueglue/qnli.yaml' 2026-09-01T00:16:55,817 adding 'lm_eval/tasks/basqueglue/utils.py' 2026-09-01T00:16:55,818 adding 'lm_eval/tasks/basqueglue/vaxx.yaml' 2026-09-01T00:16:55,819 adding 'lm_eval/tasks/basqueglue/wic.yaml' 2026-09-01T00:16:55,821 adding 'lm_eval/tasks/bbh/README.md' 2026-09-01T00:16:55,823 adding 'lm_eval/tasks/bbh/_generate_configs.py' 2026-09-01T00:16:55,825 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml' 2026-09-01T00:16:55,827 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml' 2026-09-01T00:16:55,828 adding 'lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml' 2026-09-01T00:16:55,829 adding 'lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml' 2026-09-01T00:16:55,831 adding 'lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml' 2026-09-01T00:16:55,832 adding 'lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml' 2026-09-01T00:16:55,834 adding 'lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml' 2026-09-01T00:16:55,835 adding 'lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml' 2026-09-01T00:16:55,837 adding 'lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml' 2026-09-01T00:16:55,838 adding 'lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml' 2026-09-01T00:16:55,839 adding 'lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml' 2026-09-01T00:16:55,841 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml' 2026-09-01T00:16:55,842 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:16:55,843 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml' 2026-09-01T00:16:55,845 adding 'lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml' 2026-09-01T00:16:55,846 adding 'lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml' 2026-09-01T00:16:55,847 adding 'lm_eval/tasks/bbh/cot_fewshot/navigate.yaml' 2026-09-01T00:16:55,849 adding 'lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml' 2026-09-01T00:16:55,850 adding 'lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml' 2026-09-01T00:16:55,851 adding 'lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:16:55,852 adding 'lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml' 2026-09-01T00:16:55,854 adding 'lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml' 2026-09-01T00:16:55,855 adding 'lm_eval/tasks/bbh/cot_fewshot/snarks.yaml' 2026-09-01T00:16:55,856 adding 'lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml' 2026-09-01T00:16:55,858 adding 'lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml' 2026-09-01T00:16:55,859 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:16:55,860 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:16:55,861 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:16:55,863 adding 'lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml' 2026-09-01T00:16:55,864 adding 'lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml' 2026-09-01T00:16:55,866 adding 'lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml' 2026-09-01T00:16:55,867 adding 'lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml' 2026-09-01T00:16:55,869 adding 'lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml' 2026-09-01T00:16:55,870 adding 'lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml' 2026-09-01T00:16:55,871 adding 'lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml' 2026-09-01T00:16:55,872 adding 'lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml' 2026-09-01T00:16:55,873 adding 'lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml' 2026-09-01T00:16:55,874 adding 'lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml' 2026-09-01T00:16:55,875 adding 'lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml' 2026-09-01T00:16:55,877 adding 'lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml' 2026-09-01T00:16:55,878 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml' 2026-09-01T00:16:55,879 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:16:55,880 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml' 2026-09-01T00:16:55,881 adding 'lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml' 2026-09-01T00:16:55,883 adding 'lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml' 2026-09-01T00:16:55,884 adding 'lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml' 2026-09-01T00:16:55,885 adding 'lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml' 2026-09-01T00:16:55,886 adding 'lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml' 2026-09-01T00:16:55,887 adding 'lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:16:55,889 adding 'lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml' 2026-09-01T00:16:55,890 adding 'lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml' 2026-09-01T00:16:55,891 adding 'lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml' 2026-09-01T00:16:55,892 adding 'lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml' 2026-09-01T00:16:55,894 adding 'lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml' 2026-09-01T00:16:55,895 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:16:55,896 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:16:55,897 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:16:55,899 adding 'lm_eval/tasks/bbh/cot_zeroshot/utils.py' 2026-09-01T00:16:55,900 adding 'lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml' 2026-09-01T00:16:55,901 adding 'lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml' 2026-09-01T00:16:55,903 adding 'lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml' 2026-09-01T00:16:55,904 adding 'lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml' 2026-09-01T00:16:55,906 adding 'lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml' 2026-09-01T00:16:55,907 adding 'lm_eval/tasks/bbh/fewshot/causal_judgement.yaml' 2026-09-01T00:16:55,908 adding 'lm_eval/tasks/bbh/fewshot/date_understanding.yaml' 2026-09-01T00:16:55,909 adding 'lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml' 2026-09-01T00:16:55,910 adding 'lm_eval/tasks/bbh/fewshot/dyck_languages.yaml' 2026-09-01T00:16:55,911 adding 'lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml' 2026-09-01T00:16:55,912 adding 'lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml' 2026-09-01T00:16:55,913 adding 'lm_eval/tasks/bbh/fewshot/hyperbaton.yaml' 2026-09-01T00:16:55,915 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml' 2026-09-01T00:16:55,916 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:16:55,917 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml' 2026-09-01T00:16:55,918 adding 'lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml' 2026-09-01T00:16:55,919 adding 'lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml' 2026-09-01T00:16:55,921 adding 'lm_eval/tasks/bbh/fewshot/navigate.yaml' 2026-09-01T00:16:55,922 adding 'lm_eval/tasks/bbh/fewshot/object_counting.yaml' 2026-09-01T00:16:55,923 adding 'lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml' 2026-09-01T00:16:55,924 adding 'lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:16:55,925 adding 'lm_eval/tasks/bbh/fewshot/ruin_names.yaml' 2026-09-01T00:16:55,927 adding 'lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml' 2026-09-01T00:16:55,928 adding 'lm_eval/tasks/bbh/fewshot/snarks.yaml' 2026-09-01T00:16:55,929 adding 'lm_eval/tasks/bbh/fewshot/sports_understanding.yaml' 2026-09-01T00:16:55,930 adding 'lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml' 2026-09-01T00:16:55,931 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:16:55,933 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:16:55,934 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:16:55,935 adding 'lm_eval/tasks/bbh/fewshot/web_of_lies.yaml' 2026-09-01T00:16:55,936 adding 'lm_eval/tasks/bbh/fewshot/word_sorting.yaml' 2026-09-01T00:16:55,939 adding 'lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml' 2026-09-01T00:16:55,940 adding 'lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml' 2026-09-01T00:16:55,941 adding 'lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml' 2026-09-01T00:16:55,942 adding 'lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml' 2026-09-01T00:16:55,943 adding 'lm_eval/tasks/bbh/zeroshot/date_understanding.yaml' 2026-09-01T00:16:55,945 adding 'lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml' 2026-09-01T00:16:55,946 adding 'lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml' 2026-09-01T00:16:55,947 adding 'lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml' 2026-09-01T00:16:55,948 adding 'lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml' 2026-09-01T00:16:55,949 adding 'lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml' 2026-09-01T00:16:55,950 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml' 2026-09-01T00:16:55,952 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml' 2026-09-01T00:16:55,953 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml' 2026-09-01T00:16:55,954 adding 'lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml' 2026-09-01T00:16:55,955 adding 'lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml' 2026-09-01T00:16:55,957 adding 'lm_eval/tasks/bbh/zeroshot/navigate.yaml' 2026-09-01T00:16:55,958 adding 'lm_eval/tasks/bbh/zeroshot/object_counting.yaml' 2026-09-01T00:16:55,959 adding 'lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml' 2026-09-01T00:16:55,960 adding 'lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml' 2026-09-01T00:16:55,961 adding 'lm_eval/tasks/bbh/zeroshot/ruin_names.yaml' 2026-09-01T00:16:55,963 adding 'lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml' 2026-09-01T00:16:55,964 adding 'lm_eval/tasks/bbh/zeroshot/snarks.yaml' 2026-09-01T00:16:55,965 adding 'lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml' 2026-09-01T00:16:55,966 adding 'lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml' 2026-09-01T00:16:55,967 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:16:55,968 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:16:55,970 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:16:55,971 adding 'lm_eval/tasks/bbh/zeroshot/utils.py' 2026-09-01T00:16:55,972 adding 'lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml' 2026-09-01T00:16:55,973 adding 'lm_eval/tasks/bbh/zeroshot/word_sorting.yaml' 2026-09-01T00:16:55,975 adding 'lm_eval/tasks/bbq/README.md' 2026-09-01T00:16:55,977 adding 'lm_eval/tasks/bbq/bbq_generate.yaml' 2026-09-01T00:16:55,978 adding 'lm_eval/tasks/bbq/bbq_generate_ambig.yaml' 2026-09-01T00:16:55,979 adding 'lm_eval/tasks/bbq/bbq_generate_disambig.yaml' 2026-09-01T00:16:55,980 adding 'lm_eval/tasks/bbq/bbq_multiple_choice.yaml' 2026-09-01T00:16:55,981 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_ambig.yaml' 2026-09-01T00:16:55,983 adding 'lm_eval/tasks/bbq/bbq_multiple_choice_disambig.yaml' 2026-09-01T00:16:55,985 adding 'lm_eval/tasks/bbq/utils.py' 2026-09-01T00:16:55,987 adding 'lm_eval/tasks/bear/README.md' 2026-09-01T00:16:55,988 adding 'lm_eval/tasks/bear/bear.yaml' 2026-09-01T00:16:55,989 adding 'lm_eval/tasks/bear/bear_big.yaml' 2026-09-01T00:16:55,993 adding 'lm_eval/tasks/belebele/README.md' 2026-09-01T00:16:55,994 adding 'lm_eval/tasks/belebele/_belebele.yaml' 2026-09-01T00:16:55,996 adding 'lm_eval/tasks/belebele/_default_template_yaml' 2026-09-01T00:16:55,997 adding 'lm_eval/tasks/belebele/_generate_configs.py' 2026-09-01T00:16:55,998 adding 'lm_eval/tasks/belebele/belebele_acm_Arab.yaml' 2026-09-01T00:16:55,999 adding 'lm_eval/tasks/belebele/belebele_afr_Latn.yaml' 2026-09-01T00:16:56,001 adding 'lm_eval/tasks/belebele/belebele_als_Latn.yaml' 2026-09-01T00:16:56,002 adding 'lm_eval/tasks/belebele/belebele_amh_Ethi.yaml' 2026-09-01T00:16:56,003 adding 'lm_eval/tasks/belebele/belebele_apc_Arab.yaml' 2026-09-01T00:16:56,004 adding 'lm_eval/tasks/belebele/belebele_arb_Arab.yaml' 2026-09-01T00:16:56,005 adding 'lm_eval/tasks/belebele/belebele_arb_Latn.yaml' 2026-09-01T00:16:56,007 adding 'lm_eval/tasks/belebele/belebele_ars_Arab.yaml' 2026-09-01T00:16:56,008 adding 'lm_eval/tasks/belebele/belebele_ary_Arab.yaml' 2026-09-01T00:16:56,009 adding 'lm_eval/tasks/belebele/belebele_arz_Arab.yaml' 2026-09-01T00:16:56,010 adding 'lm_eval/tasks/belebele/belebele_asm_Beng.yaml' 2026-09-01T00:16:56,011 adding 'lm_eval/tasks/belebele/belebele_azj_Latn.yaml' 2026-09-01T00:16:56,012 adding 'lm_eval/tasks/belebele/belebele_bam_Latn.yaml' 2026-09-01T00:16:56,014 adding 'lm_eval/tasks/belebele/belebele_ben_Beng.yaml' 2026-09-01T00:16:56,015 adding 'lm_eval/tasks/belebele/belebele_ben_Latn.yaml' 2026-09-01T00:16:56,016 adding 'lm_eval/tasks/belebele/belebele_bod_Tibt.yaml' 2026-09-01T00:16:56,017 adding 'lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml' 2026-09-01T00:16:56,018 adding 'lm_eval/tasks/belebele/belebele_cat_Latn.yaml' 2026-09-01T00:16:56,020 adding 'lm_eval/tasks/belebele/belebele_ceb_Latn.yaml' 2026-09-01T00:16:56,021 adding 'lm_eval/tasks/belebele/belebele_ces_Latn.yaml' 2026-09-01T00:16:56,022 adding 'lm_eval/tasks/belebele/belebele_ckb_Arab.yaml' 2026-09-01T00:16:56,023 adding 'lm_eval/tasks/belebele/belebele_dan_Latn.yaml' 2026-09-01T00:16:56,025 adding 'lm_eval/tasks/belebele/belebele_deu_Latn.yaml' 2026-09-01T00:16:56,026 adding 'lm_eval/tasks/belebele/belebele_ell_Grek.yaml' 2026-09-01T00:16:56,027 adding 'lm_eval/tasks/belebele/belebele_eng_Latn.yaml' 2026-09-01T00:16:56,028 adding 'lm_eval/tasks/belebele/belebele_est_Latn.yaml' 2026-09-01T00:16:56,029 adding 'lm_eval/tasks/belebele/belebele_eus_Latn.yaml' 2026-09-01T00:16:56,030 adding 'lm_eval/tasks/belebele/belebele_fin_Latn.yaml' 2026-09-01T00:16:56,032 adding 'lm_eval/tasks/belebele/belebele_fra_Latn.yaml' 2026-09-01T00:16:56,033 adding 'lm_eval/tasks/belebele/belebele_fuv_Latn.yaml' 2026-09-01T00:16:56,034 adding 'lm_eval/tasks/belebele/belebele_gaz_Latn.yaml' 2026-09-01T00:16:56,035 adding 'lm_eval/tasks/belebele/belebele_grn_Latn.yaml' 2026-09-01T00:16:56,036 adding 'lm_eval/tasks/belebele/belebele_guj_Gujr.yaml' 2026-09-01T00:16:56,037 adding 'lm_eval/tasks/belebele/belebele_hat_Latn.yaml' 2026-09-01T00:16:56,038 adding 'lm_eval/tasks/belebele/belebele_hau_Latn.yaml' 2026-09-01T00:16:56,039 adding 'lm_eval/tasks/belebele/belebele_heb_Hebr.yaml' 2026-09-01T00:16:56,041 adding 'lm_eval/tasks/belebele/belebele_hin_Deva.yaml' 2026-09-01T00:16:56,042 adding 'lm_eval/tasks/belebele/belebele_hin_Latn.yaml' 2026-09-01T00:16:56,043 adding 'lm_eval/tasks/belebele/belebele_hrv_Latn.yaml' 2026-09-01T00:16:56,044 adding 'lm_eval/tasks/belebele/belebele_hun_Latn.yaml' 2026-09-01T00:16:56,045 adding 'lm_eval/tasks/belebele/belebele_hye_Armn.yaml' 2026-09-01T00:16:56,047 adding 'lm_eval/tasks/belebele/belebele_ibo_Latn.yaml' 2026-09-01T00:16:56,048 adding 'lm_eval/tasks/belebele/belebele_ilo_Latn.yaml' 2026-09-01T00:16:56,049 adding 'lm_eval/tasks/belebele/belebele_ind_Latn.yaml' 2026-09-01T00:16:56,050 adding 'lm_eval/tasks/belebele/belebele_isl_Latn.yaml' 2026-09-01T00:16:56,051 adding 'lm_eval/tasks/belebele/belebele_ita_Latn.yaml' 2026-09-01T00:16:56,052 adding 'lm_eval/tasks/belebele/belebele_jav_Latn.yaml' 2026-09-01T00:16:56,053 adding 'lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml' 2026-09-01T00:16:56,055 adding 'lm_eval/tasks/belebele/belebele_kac_Latn.yaml' 2026-09-01T00:16:56,056 adding 'lm_eval/tasks/belebele/belebele_kan_Knda.yaml' 2026-09-01T00:16:56,057 adding 'lm_eval/tasks/belebele/belebele_kat_Geor.yaml' 2026-09-01T00:16:56,058 adding 'lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml' 2026-09-01T00:16:56,059 adding 'lm_eval/tasks/belebele/belebele_kea_Latn.yaml' 2026-09-01T00:16:56,060 adding 'lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml' 2026-09-01T00:16:56,061 adding 'lm_eval/tasks/belebele/belebele_khm_Khmr.yaml' 2026-09-01T00:16:56,063 adding 'lm_eval/tasks/belebele/belebele_kin_Latn.yaml' 2026-09-01T00:16:56,064 adding 'lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml' 2026-09-01T00:16:56,065 adding 'lm_eval/tasks/belebele/belebele_kor_Hang.yaml' 2026-09-01T00:16:56,066 adding 'lm_eval/tasks/belebele/belebele_lao_Laoo.yaml' 2026-09-01T00:16:56,068 adding 'lm_eval/tasks/belebele/belebele_lin_Latn.yaml' 2026-09-01T00:16:56,069 adding 'lm_eval/tasks/belebele/belebele_lit_Latn.yaml' 2026-09-01T00:16:56,070 adding 'lm_eval/tasks/belebele/belebele_lug_Latn.yaml' 2026-09-01T00:16:56,071 adding 'lm_eval/tasks/belebele/belebele_luo_Latn.yaml' 2026-09-01T00:16:56,072 adding 'lm_eval/tasks/belebele/belebele_lvs_Latn.yaml' 2026-09-01T00:16:56,074 adding 'lm_eval/tasks/belebele/belebele_mal_Mlym.yaml' 2026-09-01T00:16:56,075 adding 'lm_eval/tasks/belebele/belebele_mar_Deva.yaml' 2026-09-01T00:16:56,076 adding 'lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml' 2026-09-01T00:16:56,077 adding 'lm_eval/tasks/belebele/belebele_mlt_Latn.yaml' 2026-09-01T00:16:56,079 adding 'lm_eval/tasks/belebele/belebele_mri_Latn.yaml' 2026-09-01T00:16:56,080 adding 'lm_eval/tasks/belebele/belebele_mya_Mymr.yaml' 2026-09-01T00:16:56,081 adding 'lm_eval/tasks/belebele/belebele_nld_Latn.yaml' 2026-09-01T00:16:56,082 adding 'lm_eval/tasks/belebele/belebele_nob_Latn.yaml' 2026-09-01T00:16:56,083 adding 'lm_eval/tasks/belebele/belebele_npi_Deva.yaml' 2026-09-01T00:16:56,084 adding 'lm_eval/tasks/belebele/belebele_npi_Latn.yaml' 2026-09-01T00:16:56,086 adding 'lm_eval/tasks/belebele/belebele_nso_Latn.yaml' 2026-09-01T00:16:56,087 adding 'lm_eval/tasks/belebele/belebele_nya_Latn.yaml' 2026-09-01T00:16:56,088 adding 'lm_eval/tasks/belebele/belebele_ory_Orya.yaml' 2026-09-01T00:16:56,089 adding 'lm_eval/tasks/belebele/belebele_pan_Guru.yaml' 2026-09-01T00:16:56,090 adding 'lm_eval/tasks/belebele/belebele_pbt_Arab.yaml' 2026-09-01T00:16:56,091 adding 'lm_eval/tasks/belebele/belebele_pes_Arab.yaml' 2026-09-01T00:16:56,092 adding 'lm_eval/tasks/belebele/belebele_plt_Latn.yaml' 2026-09-01T00:16:56,093 adding 'lm_eval/tasks/belebele/belebele_pol_Latn.yaml' 2026-09-01T00:16:56,094 adding 'lm_eval/tasks/belebele/belebele_por_Latn.yaml' 2026-09-01T00:16:56,096 adding 'lm_eval/tasks/belebele/belebele_ron_Latn.yaml' 2026-09-01T00:16:56,097 adding 'lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml' 2026-09-01T00:16:56,098 adding 'lm_eval/tasks/belebele/belebele_shn_Mymr.yaml' 2026-09-01T00:16:56,099 adding 'lm_eval/tasks/belebele/belebele_sin_Latn.yaml' 2026-09-01T00:16:56,100 adding 'lm_eval/tasks/belebele/belebele_sin_Sinh.yaml' 2026-09-01T00:16:56,101 adding 'lm_eval/tasks/belebele/belebele_slk_Latn.yaml' 2026-09-01T00:16:56,102 adding 'lm_eval/tasks/belebele/belebele_slv_Latn.yaml' 2026-09-01T00:16:56,104 adding 'lm_eval/tasks/belebele/belebele_sna_Latn.yaml' 2026-09-01T00:16:56,105 adding 'lm_eval/tasks/belebele/belebele_snd_Arab.yaml' 2026-09-01T00:16:56,106 adding 'lm_eval/tasks/belebele/belebele_som_Latn.yaml' 2026-09-01T00:16:56,107 adding 'lm_eval/tasks/belebele/belebele_sot_Latn.yaml' 2026-09-01T00:16:56,108 adding 'lm_eval/tasks/belebele/belebele_spa_Latn.yaml' 2026-09-01T00:16:56,109 adding 'lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml' 2026-09-01T00:16:56,110 adding 'lm_eval/tasks/belebele/belebele_ssw_Latn.yaml' 2026-09-01T00:16:56,112 adding 'lm_eval/tasks/belebele/belebele_sun_Latn.yaml' 2026-09-01T00:16:56,113 adding 'lm_eval/tasks/belebele/belebele_swe_Latn.yaml' 2026-09-01T00:16:56,114 adding 'lm_eval/tasks/belebele/belebele_swh_Latn.yaml' 2026-09-01T00:16:56,115 adding 'lm_eval/tasks/belebele/belebele_tam_Taml.yaml' 2026-09-01T00:16:56,116 adding 'lm_eval/tasks/belebele/belebele_tel_Telu.yaml' 2026-09-01T00:16:56,117 adding 'lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml' 2026-09-01T00:16:56,118 adding 'lm_eval/tasks/belebele/belebele_tgl_Latn.yaml' 2026-09-01T00:16:56,120 adding 'lm_eval/tasks/belebele/belebele_tha_Thai.yaml' 2026-09-01T00:16:56,121 adding 'lm_eval/tasks/belebele/belebele_tir_Ethi.yaml' 2026-09-01T00:16:56,122 adding 'lm_eval/tasks/belebele/belebele_tsn_Latn.yaml' 2026-09-01T00:16:56,123 adding 'lm_eval/tasks/belebele/belebele_tso_Latn.yaml' 2026-09-01T00:16:56,124 adding 'lm_eval/tasks/belebele/belebele_tur_Latn.yaml' 2026-09-01T00:16:56,125 adding 'lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml' 2026-09-01T00:16:56,127 adding 'lm_eval/tasks/belebele/belebele_urd_Arab.yaml' 2026-09-01T00:16:56,128 adding 'lm_eval/tasks/belebele/belebele_urd_Latn.yaml' 2026-09-01T00:16:56,129 adding 'lm_eval/tasks/belebele/belebele_uzn_Latn.yaml' 2026-09-01T00:16:56,130 adding 'lm_eval/tasks/belebele/belebele_vie_Latn.yaml' 2026-09-01T00:16:56,131 adding 'lm_eval/tasks/belebele/belebele_war_Latn.yaml' 2026-09-01T00:16:56,133 adding 'lm_eval/tasks/belebele/belebele_wol_Latn.yaml' 2026-09-01T00:16:56,134 adding 'lm_eval/tasks/belebele/belebele_xho_Latn.yaml' 2026-09-01T00:16:56,135 adding 'lm_eval/tasks/belebele/belebele_yor_Latn.yaml' 2026-09-01T00:16:56,136 adding 'lm_eval/tasks/belebele/belebele_zho_Hans.yaml' 2026-09-01T00:16:56,137 adding 'lm_eval/tasks/belebele/belebele_zho_Hant.yaml' 2026-09-01T00:16:56,139 adding 'lm_eval/tasks/belebele/belebele_zsm_Latn.yaml' 2026-09-01T00:16:56,140 adding 'lm_eval/tasks/belebele/belebele_zul_Latn.yaml' 2026-09-01T00:16:56,142 adding 'lm_eval/tasks/benchmarks/README.md' 2026-09-01T00:16:56,143 adding 'lm_eval/tasks/benchmarks/minerva_math.yaml' 2026-09-01T00:16:56,144 adding 'lm_eval/tasks/benchmarks/openllm.yaml' 2026-09-01T00:16:56,145 adding 'lm_eval/tasks/benchmarks/pythia.yaml' 2026-09-01T00:16:56,147 adding 'lm_eval/tasks/benchmarks/t0_eval.yaml' 2026-09-01T00:16:56,148 adding 'lm_eval/tasks/benchmarks/flan/_held_in_template_yaml' 2026-09-01T00:16:56,150 adding 'lm_eval/tasks/benchmarks/flan/flan_held_in.yaml' 2026-09-01T00:16:56,151 adding 'lm_eval/tasks/benchmarks/flan/flan_held_out.yaml' 2026-09-01T00:16:56,153 adding 'lm_eval/tasks/benchmarks/multimedqa/README.md' 2026-09-01T00:16:56,154 adding 'lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml' 2026-09-01T00:16:56,156 adding 'lm_eval/tasks/bertaqa/README.md' 2026-09-01T00:16:56,157 adding 'lm_eval/tasks/bertaqa/_bertaqa_template' 2026-09-01T00:16:56,158 adding 'lm_eval/tasks/bertaqa/bertaqa_en.yaml' 2026-09-01T00:16:56,160 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml' 2026-09-01T00:16:56,161 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml' 2026-09-01T00:16:56,162 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml' 2026-09-01T00:16:56,163 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml' 2026-09-01T00:16:56,164 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml' 2026-09-01T00:16:56,165 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml' 2026-09-01T00:16:56,166 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml' 2026-09-01T00:16:56,167 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml' 2026-09-01T00:16:56,168 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml' 2026-09-01T00:16:56,170 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml' 2026-09-01T00:16:56,171 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml' 2026-09-01T00:16:56,172 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml' 2026-09-01T00:16:56,173 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml' 2026-09-01T00:16:56,174 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml' 2026-09-01T00:16:56,175 adding 'lm_eval/tasks/bertaqa/bertaqa_eu.yaml' 2026-09-01T00:16:56,178 adding 'lm_eval/tasks/bhs/README.md' 2026-09-01T00:16:56,179 adding 'lm_eval/tasks/bhs/_template_yaml' 2026-09-01T00:16:56,180 adding 'lm_eval/tasks/bhs/basque-DO-S_DO_V_AUX.yaml' 2026-09-01T00:16:56,181 adding 'lm_eval/tasks/bhs/basque-DO-S_IO_DO_V_AUX.yaml' 2026-09-01T00:16:56,182 adding 'lm_eval/tasks/bhs/basque-IO-IO_S_V_AUX.yaml' 2026-09-01T00:16:56,184 adding 'lm_eval/tasks/bhs/basque-IO-S_IO_DO_V_AUX.yaml' 2026-09-01T00:16:56,185 adding 'lm_eval/tasks/bhs/basque-S-IO_S_V_AUX.yaml' 2026-09-01T00:16:56,186 adding 'lm_eval/tasks/bhs/basque-S-S_DO_V_AUX.yaml' 2026-09-01T00:16:56,187 adding 'lm_eval/tasks/bhs/basque-S-S_IO_DO_V_AUX.yaml' 2026-09-01T00:16:56,188 adding 'lm_eval/tasks/bhs/basque-S-S_V_AUX.yaml' 2026-09-01T00:16:56,189 adding 'lm_eval/tasks/bhs/bhs_basque.yaml' 2026-09-01T00:16:56,190 adding 'lm_eval/tasks/bhs/bhs_hindi.yaml' 2026-09-01T00:16:56,192 adding 'lm_eval/tasks/bhs/bhs_swahili.yaml' 2026-09-01T00:16:56,193 adding 'lm_eval/tasks/bhs/hindi-S_O_V.yaml' 2026-09-01T00:16:56,194 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_O_V.yaml' 2026-09-01T00:16:56,196 adding 'lm_eval/tasks/bhs/hindi-S_PossPRN_PossN_O_V.yaml' 2026-09-01T00:16:56,197 adding 'lm_eval/tasks/bhs/hindi-S_ne_O_V.yaml' 2026-09-01T00:16:56,198 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_O_V.yaml' 2026-09-01T00:16:56,199 adding 'lm_eval/tasks/bhs/hindi-S_ne_PossPRN_PossN_O_V.yaml' 2026-09-01T00:16:56,200 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_V_ni_AN.yaml' 2026-09-01T00:16:56,201 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_AP_ni_AN.yaml' 2026-09-01T00:16:56,203 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V.yaml' 2026-09-01T00:16:56,204 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_A_V1_V2.yaml' 2026-09-01T00:16:56,205 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_V.yaml' 2026-09-01T00:16:56,207 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_D_ni_A.yaml' 2026-09-01T00:16:56,208 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_V.yaml' 2026-09-01T00:16:56,209 adding 'lm_eval/tasks/bhs/swahili-N_of_Poss_ni_A.yaml' 2026-09-01T00:16:56,212 adding 'lm_eval/tasks/bigbench/README.md' 2026-09-01T00:16:56,213 adding 'lm_eval/tasks/bigbench/generate_tasks.py' 2026-09-01T00:16:56,215 adding 'lm_eval/tasks/bigbench/generate_until_template_yaml' 2026-09-01T00:16:56,216 adding 'lm_eval/tasks/bigbench/multiple_choice_template_a_yaml' 2026-09-01T00:16:56,217 adding 'lm_eval/tasks/bigbench/multiple_choice_template_b_yaml' 2026-09-01T00:16:56,218 adding 'lm_eval/tasks/bigbench/push_bigbench_dataset.py' 2026-09-01T00:16:56,219 adding 'lm_eval/tasks/bigbench/utils.py' 2026-09-01T00:16:56,224 adding 'lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml' 2026-09-01T00:16:56,226 adding 'lm_eval/tasks/bigbench/generate_until/anachronisms.yaml' 2026-09-01T00:16:56,227 adding 'lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml' 2026-09-01T00:16:56,228 adding 'lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml' 2026-09-01T00:16:56,229 adding 'lm_eval/tasks/bigbench/generate_until/arithmetic.yaml' 2026-09-01T00:16:56,230 adding 'lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml' 2026-09-01T00:16:56,231 adding 'lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml' 2026-09-01T00:16:56,232 adding 'lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml' 2026-09-01T00:16:56,233 adding 'lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml' 2026-09-01T00:16:56,235 adding 'lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml' 2026-09-01T00:16:56,236 adding 'lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml' 2026-09-01T00:16:56,237 adding 'lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml' 2026-09-01T00:16:56,238 adding 'lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml' 2026-09-01T00:16:56,239 adding 'lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml' 2026-09-01T00:16:56,241 adding 'lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml' 2026-09-01T00:16:56,242 adding 'lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml' 2026-09-01T00:16:56,243 adding 'lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml' 2026-09-01T00:16:56,244 adding 'lm_eval/tasks/bigbench/generate_until/code_line_description.yaml' 2026-09-01T00:16:56,245 adding 'lm_eval/tasks/bigbench/generate_until/codenames.yaml' 2026-09-01T00:16:56,247 adding 'lm_eval/tasks/bigbench/generate_until/color.yaml' 2026-09-01T00:16:56,248 adding 'lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml' 2026-09-01T00:16:56,249 adding 'lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml' 2026-09-01T00:16:56,250 adding 'lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml' 2026-09-01T00:16:56,251 adding 'lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml' 2026-09-01T00:16:56,253 adding 'lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml' 2026-09-01T00:16:56,254 adding 'lm_eval/tasks/bigbench/generate_until/crass_ai.yaml' 2026-09-01T00:16:56,255 adding 'lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml' 2026-09-01T00:16:56,256 adding 'lm_eval/tasks/bigbench/generate_until/cryptonite.yaml' 2026-09-01T00:16:56,258 adding 'lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml' 2026-09-01T00:16:56,259 adding 'lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml' 2026-09-01T00:16:56,260 adding 'lm_eval/tasks/bigbench/generate_until/date_understanding.yaml' 2026-09-01T00:16:56,261 adding 'lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml' 2026-09-01T00:16:56,262 adding 'lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml' 2026-09-01T00:16:56,264 adding 'lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml' 2026-09-01T00:16:56,265 adding 'lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml' 2026-09-01T00:16:56,266 adding 'lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml' 2026-09-01T00:16:56,267 adding 'lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml' 2026-09-01T00:16:56,269 adding 'lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml' 2026-09-01T00:16:56,270 adding 'lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml' 2026-09-01T00:16:56,271 adding 'lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml' 2026-09-01T00:16:56,272 adding 'lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml' 2026-09-01T00:16:56,273 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml' 2026-09-01T00:16:56,274 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml' 2026-09-01T00:16:56,276 adding 'lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml' 2026-09-01T00:16:56,277 adding 'lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml' 2026-09-01T00:16:56,278 adding 'lm_eval/tasks/bigbench/generate_until/fact_checker.yaml' 2026-09-01T00:16:56,279 adding 'lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml' 2026-09-01T00:16:56,280 adding 'lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml' 2026-09-01T00:16:56,281 adding 'lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml' 2026-09-01T00:16:56,282 adding 'lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml' 2026-09-01T00:16:56,284 adding 'lm_eval/tasks/bigbench/generate_until/gem.yaml' 2026-09-01T00:16:56,285 adding 'lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml' 2026-09-01T00:16:56,286 adding 'lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml' 2026-09-01T00:16:56,287 adding 'lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml' 2026-09-01T00:16:56,288 adding 'lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml' 2026-09-01T00:16:56,289 adding 'lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml' 2026-09-01T00:16:56,290 adding 'lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml' 2026-09-01T00:16:56,291 adding 'lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml' 2026-09-01T00:16:56,292 adding 'lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml' 2026-09-01T00:16:56,293 adding 'lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml' 2026-09-01T00:16:56,295 adding 'lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml' 2026-09-01T00:16:56,296 adding 'lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml' 2026-09-01T00:16:56,297 adding 'lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml' 2026-09-01T00:16:56,298 adding 'lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml' 2026-09-01T00:16:56,299 adding 'lm_eval/tasks/bigbench/generate_until/implicatures.yaml' 2026-09-01T00:16:56,300 adding 'lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml' 2026-09-01T00:16:56,302 adding 'lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml' 2026-09-01T00:16:56,303 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml' 2026-09-01T00:16:56,304 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml' 2026-09-01T00:16:56,306 adding 'lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml' 2026-09-01T00:16:56,307 adding 'lm_eval/tasks/bigbench/generate_until/irony_identification.yaml' 2026-09-01T00:16:56,308 adding 'lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml' 2026-09-01T00:16:56,309 adding 'lm_eval/tasks/bigbench/generate_until/kannada.yaml' 2026-09-01T00:16:56,310 adding 'lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml' 2026-09-01T00:16:56,311 adding 'lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml' 2026-09-01T00:16:56,313 adding 'lm_eval/tasks/bigbench/generate_until/language_games.yaml' 2026-09-01T00:16:56,314 adding 'lm_eval/tasks/bigbench/generate_until/language_identification.yaml' 2026-09-01T00:16:56,315 adding 'lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml' 2026-09-01T00:16:56,316 adding 'lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml' 2026-09-01T00:16:56,318 adding 'lm_eval/tasks/bigbench/generate_until/list_functions.yaml' 2026-09-01T00:16:56,319 adding 'lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml' 2026-09-01T00:16:56,320 adding 'lm_eval/tasks/bigbench/generate_until/logical_args.yaml' 2026-09-01T00:16:56,321 adding 'lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml' 2026-09-01T00:16:56,322 adding 'lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml' 2026-09-01T00:16:56,323 adding 'lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml' 2026-09-01T00:16:56,324 adding 'lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml' 2026-09-01T00:16:56,325 adding 'lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml' 2026-09-01T00:16:56,326 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml' 2026-09-01T00:16:56,328 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml' 2026-09-01T00:16:56,329 adding 'lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml' 2026-09-01T00:16:56,330 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions.yaml' 2026-09-01T00:16:56,331 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml' 2026-09-01T00:16:56,332 adding 'lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml' 2026-09-01T00:16:56,333 adding 'lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml' 2026-09-01T00:16:56,335 adding 'lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml' 2026-09-01T00:16:56,336 adding 'lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml' 2026-09-01T00:16:56,337 adding 'lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml' 2026-09-01T00:16:56,338 adding 'lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml' 2026-09-01T00:16:56,339 adding 'lm_eval/tasks/bigbench/generate_until/multiemo.yaml' 2026-09-01T00:16:56,340 adding 'lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml' 2026-09-01T00:16:56,341 adding 'lm_eval/tasks/bigbench/generate_until/navigate.yaml' 2026-09-01T00:16:56,343 adding 'lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml' 2026-09-01T00:16:56,344 adding 'lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml' 2026-09-01T00:16:56,345 adding 'lm_eval/tasks/bigbench/generate_until/object_counting.yaml' 2026-09-01T00:16:56,346 adding 'lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml' 2026-09-01T00:16:56,347 adding 'lm_eval/tasks/bigbench/generate_until/operators.yaml' 2026-09-01T00:16:56,349 adding 'lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml' 2026-09-01T00:16:56,350 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml' 2026-09-01T00:16:56,351 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml' 2026-09-01T00:16:56,352 adding 'lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml' 2026-09-01T00:16:56,353 adding 'lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml' 2026-09-01T00:16:56,354 adding 'lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml' 2026-09-01T00:16:56,356 adding 'lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml' 2026-09-01T00:16:56,357 adding 'lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml' 2026-09-01T00:16:56,358 adding 'lm_eval/tasks/bigbench/generate_until/physics.yaml' 2026-09-01T00:16:56,359 adding 'lm_eval/tasks/bigbench/generate_until/physics_questions.yaml' 2026-09-01T00:16:56,360 adding 'lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml' 2026-09-01T00:16:56,362 adding 'lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml' 2026-09-01T00:16:56,363 adding 'lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml' 2026-09-01T00:16:56,364 adding 'lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml' 2026-09-01T00:16:56,365 adding 'lm_eval/tasks/bigbench/generate_until/question_selection.yaml' 2026-09-01T00:16:56,366 adding 'lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml' 2026-09-01T00:16:56,368 adding 'lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml' 2026-09-01T00:16:56,369 adding 'lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml' 2026-09-01T00:16:56,370 adding 'lm_eval/tasks/bigbench/generate_until/rephrase.yaml' 2026-09-01T00:16:56,371 adding 'lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml' 2026-09-01T00:16:56,372 adding 'lm_eval/tasks/bigbench/generate_until/ruin_names.yaml' 2026-09-01T00:16:56,373 adding 'lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml' 2026-09-01T00:16:56,374 adding 'lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml' 2026-09-01T00:16:56,375 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml' 2026-09-01T00:16:56,377 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml' 2026-09-01T00:16:56,378 adding 'lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml' 2026-09-01T00:16:56,379 adding 'lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml' 2026-09-01T00:16:56,380 adding 'lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml' 2026-09-01T00:16:56,381 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml' 2026-09-01T00:16:56,382 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml' 2026-09-01T00:16:56,383 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml' 2026-09-01T00:16:56,384 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml' 2026-09-01T00:16:56,386 adding 'lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml' 2026-09-01T00:16:56,387 adding 'lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml' 2026-09-01T00:16:56,388 adding 'lm_eval/tasks/bigbench/generate_until/snarks.yaml' 2026-09-01T00:16:56,389 adding 'lm_eval/tasks/bigbench/generate_until/social_iqa.yaml' 2026-09-01T00:16:56,390 adding 'lm_eval/tasks/bigbench/generate_until/social_support.yaml' 2026-09-01T00:16:56,391 adding 'lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml' 2026-09-01T00:16:56,393 adding 'lm_eval/tasks/bigbench/generate_until/strange_stories.yaml' 2026-09-01T00:16:56,394 adding 'lm_eval/tasks/bigbench/generate_until/strategyqa.yaml' 2026-09-01T00:16:56,395 adding 'lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml' 2026-09-01T00:16:56,396 adding 'lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml' 2026-09-01T00:16:56,397 adding 'lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml' 2026-09-01T00:16:56,398 adding 'lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml' 2026-09-01T00:16:56,400 adding 'lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml' 2026-09-01T00:16:56,401 adding 'lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml' 2026-09-01T00:16:56,402 adding 'lm_eval/tasks/bigbench/generate_until/tense.yaml' 2026-09-01T00:16:56,403 adding 'lm_eval/tasks/bigbench/generate_until/timedial.yaml' 2026-09-01T00:16:56,404 adding 'lm_eval/tasks/bigbench/generate_until/topical_chat.yaml' 2026-09-01T00:16:56,405 adding 'lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml' 2026-09-01T00:16:56,407 adding 'lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml' 2026-09-01T00:16:56,408 adding 'lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml' 2026-09-01T00:16:56,409 adding 'lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml' 2026-09-01T00:16:56,411 adding 'lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml' 2026-09-01T00:16:56,412 adding 'lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml' 2026-09-01T00:16:56,413 adding 'lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml' 2026-09-01T00:16:56,414 adding 'lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml' 2026-09-01T00:16:56,415 adding 'lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml' 2026-09-01T00:16:56,416 adding 'lm_eval/tasks/bigbench/generate_until/winowhy.yaml' 2026-09-01T00:16:56,417 adding 'lm_eval/tasks/bigbench/generate_until/word_sorting.yaml' 2026-09-01T00:16:56,418 adding 'lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml' 2026-09-01T00:16:56,422 adding 'lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml' 2026-09-01T00:16:56,423 adding 'lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml' 2026-09-01T00:16:56,424 adding 'lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml' 2026-09-01T00:16:56,425 adding 'lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml' 2026-09-01T00:16:56,426 adding 'lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml' 2026-09-01T00:16:56,428 adding 'lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml' 2026-09-01T00:16:56,429 adding 'lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml' 2026-09-01T00:16:56,430 adding 'lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml' 2026-09-01T00:16:56,431 adding 'lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml' 2026-09-01T00:16:56,432 adding 'lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml' 2026-09-01T00:16:56,433 adding 'lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml' 2026-09-01T00:16:56,435 adding 'lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml' 2026-09-01T00:16:56,436 adding 'lm_eval/tasks/bigbench/multiple_choice/color.yaml' 2026-09-01T00:16:56,437 adding 'lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml' 2026-09-01T00:16:56,438 adding 'lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml' 2026-09-01T00:16:56,439 adding 'lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml' 2026-09-01T00:16:56,440 adding 'lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml' 2026-09-01T00:16:56,441 adding 'lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml' 2026-09-01T00:16:56,443 adding 'lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml' 2026-09-01T00:16:56,444 adding 'lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml' 2026-09-01T00:16:56,445 adding 'lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml' 2026-09-01T00:16:56,446 adding 'lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml' 2026-09-01T00:16:56,447 adding 'lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml' 2026-09-01T00:16:56,448 adding 'lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml' 2026-09-01T00:16:56,450 adding 'lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml' 2026-09-01T00:16:56,451 adding 'lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml' 2026-09-01T00:16:56,452 adding 'lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml' 2026-09-01T00:16:56,453 adding 'lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml' 2026-09-01T00:16:56,454 adding 'lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml' 2026-09-01T00:16:56,455 adding 'lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml' 2026-09-01T00:16:56,457 adding 'lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml' 2026-09-01T00:16:56,458 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml' 2026-09-01T00:16:56,459 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml' 2026-09-01T00:16:56,460 adding 'lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml' 2026-09-01T00:16:56,461 adding 'lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml' 2026-09-01T00:16:56,463 adding 'lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml' 2026-09-01T00:16:56,464 adding 'lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml' 2026-09-01T00:16:56,465 adding 'lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml' 2026-09-01T00:16:56,466 adding 'lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml' 2026-09-01T00:16:56,467 adding 'lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml' 2026-09-01T00:16:56,468 adding 'lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml' 2026-09-01T00:16:56,469 adding 'lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml' 2026-09-01T00:16:56,471 adding 'lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml' 2026-09-01T00:16:56,472 adding 'lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml' 2026-09-01T00:16:56,473 adding 'lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml' 2026-09-01T00:16:56,474 adding 'lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml' 2026-09-01T00:16:56,475 adding 'lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml' 2026-09-01T00:16:56,476 adding 'lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml' 2026-09-01T00:16:56,478 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml' 2026-09-01T00:16:56,479 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml' 2026-09-01T00:16:56,480 adding 'lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml' 2026-09-01T00:16:56,481 adding 'lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml' 2026-09-01T00:16:56,482 adding 'lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml' 2026-09-01T00:16:56,483 adding 'lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml' 2026-09-01T00:16:56,485 adding 'lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml' 2026-09-01T00:16:56,486 adding 'lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml' 2026-09-01T00:16:56,487 adding 'lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml' 2026-09-01T00:16:56,488 adding 'lm_eval/tasks/bigbench/multiple_choice/kannada.yaml' 2026-09-01T00:16:56,489 adding 'lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml' 2026-09-01T00:16:56,490 adding 'lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml' 2026-09-01T00:16:56,491 adding 'lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml' 2026-09-01T00:16:56,493 adding 'lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml' 2026-09-01T00:16:56,494 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml' 2026-09-01T00:16:56,495 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml' 2026-09-01T00:16:56,496 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml' 2026-09-01T00:16:56,497 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml' 2026-09-01T00:16:56,499 adding 'lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml' 2026-09-01T00:16:56,500 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml' 2026-09-01T00:16:56,501 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml' 2026-09-01T00:16:56,502 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml' 2026-09-01T00:16:56,504 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml' 2026-09-01T00:16:56,505 adding 'lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml' 2026-09-01T00:16:56,506 adding 'lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml' 2026-09-01T00:16:56,507 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml' 2026-09-01T00:16:56,508 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml' 2026-09-01T00:16:56,510 adding 'lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml' 2026-09-01T00:16:56,511 adding 'lm_eval/tasks/bigbench/multiple_choice/navigate.yaml' 2026-09-01T00:16:56,512 adding 'lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml' 2026-09-01T00:16:56,513 adding 'lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml' 2026-09-01T00:16:56,514 adding 'lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml' 2026-09-01T00:16:56,516 adding 'lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml' 2026-09-01T00:16:56,517 adding 'lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml' 2026-09-01T00:16:56,518 adding 'lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml' 2026-09-01T00:16:56,519 adding 'lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml' 2026-09-01T00:16:56,520 adding 'lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml' 2026-09-01T00:16:56,521 adding 'lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml' 2026-09-01T00:16:56,522 adding 'lm_eval/tasks/bigbench/multiple_choice/physics.yaml' 2026-09-01T00:16:56,523 adding 'lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml' 2026-09-01T00:16:56,524 adding 'lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml' 2026-09-01T00:16:56,526 adding 'lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml' 2026-09-01T00:16:56,527 adding 'lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml' 2026-09-01T00:16:56,528 adding 'lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml' 2026-09-01T00:16:56,529 adding 'lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml' 2026-09-01T00:16:56,530 adding 'lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml' 2026-09-01T00:16:56,531 adding 'lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml' 2026-09-01T00:16:56,533 adding 'lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml' 2026-09-01T00:16:56,534 adding 'lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml' 2026-09-01T00:16:56,535 adding 'lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml' 2026-09-01T00:16:56,536 adding 'lm_eval/tasks/bigbench/multiple_choice/snarks.yaml' 2026-09-01T00:16:56,537 adding 'lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml' 2026-09-01T00:16:56,538 adding 'lm_eval/tasks/bigbench/multiple_choice/social_support.yaml' 2026-09-01T00:16:56,540 adding 'lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml' 2026-09-01T00:16:56,541 adding 'lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml' 2026-09-01T00:16:56,542 adding 'lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml' 2026-09-01T00:16:56,543 adding 'lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml' 2026-09-01T00:16:56,544 adding 'lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml' 2026-09-01T00:16:56,545 adding 'lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml' 2026-09-01T00:16:56,547 adding 'lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml' 2026-09-01T00:16:56,548 adding 'lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml' 2026-09-01T00:16:56,549 adding 'lm_eval/tasks/bigbench/multiple_choice/timedial.yaml' 2026-09-01T00:16:56,550 adding 'lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml' 2026-09-01T00:16:56,551 adding 'lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml' 2026-09-01T00:16:56,552 adding 'lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml' 2026-09-01T00:16:56,553 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml' 2026-09-01T00:16:56,555 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml' 2026-09-01T00:16:56,556 adding 'lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml' 2026-09-01T00:16:56,557 adding 'lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml' 2026-09-01T00:16:56,558 adding 'lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml' 2026-09-01T00:16:56,559 adding 'lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml' 2026-09-01T00:16:56,563 adding 'lm_eval/tasks/blimp/README.md' 2026-09-01T00:16:56,564 adding 'lm_eval/tasks/blimp/_blimp.yaml' 2026-09-01T00:16:56,565 adding 'lm_eval/tasks/blimp/_template_yaml' 2026-09-01T00:16:56,567 adding 'lm_eval/tasks/blimp/adjunct_island.yaml' 2026-09-01T00:16:56,568 adding 'lm_eval/tasks/blimp/anaphor_gender_agreement.yaml' 2026-09-01T00:16:56,569 adding 'lm_eval/tasks/blimp/anaphor_number_agreement.yaml' 2026-09-01T00:16:56,570 adding 'lm_eval/tasks/blimp/animate_subject_passive.yaml' 2026-09-01T00:16:56,571 adding 'lm_eval/tasks/blimp/animate_subject_trans.yaml' 2026-09-01T00:16:56,572 adding 'lm_eval/tasks/blimp/causative.yaml' 2026-09-01T00:16:56,573 adding 'lm_eval/tasks/blimp/complex_NP_island.yaml' 2026-09-01T00:16:56,574 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml' 2026-09-01T00:16:56,576 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml' 2026-09-01T00:16:56,577 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml' 2026-09-01T00:16:56,578 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml' 2026-09-01T00:16:56,579 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml' 2026-09-01T00:16:56,580 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml' 2026-09-01T00:16:56,581 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml' 2026-09-01T00:16:56,582 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml' 2026-09-01T00:16:56,584 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml' 2026-09-01T00:16:56,585 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml' 2026-09-01T00:16:56,586 adding 'lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml' 2026-09-01T00:16:56,587 adding 'lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml' 2026-09-01T00:16:56,588 adding 'lm_eval/tasks/blimp/drop_argument.yaml' 2026-09-01T00:16:56,589 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml' 2026-09-01T00:16:56,590 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml' 2026-09-01T00:16:56,591 adding 'lm_eval/tasks/blimp/existential_there_object_raising.yaml' 2026-09-01T00:16:56,593 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml' 2026-09-01T00:16:56,594 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml' 2026-09-01T00:16:56,595 adding 'lm_eval/tasks/blimp/existential_there_subject_raising.yaml' 2026-09-01T00:16:56,596 adding 'lm_eval/tasks/blimp/expletive_it_object_raising.yaml' 2026-09-01T00:16:56,597 adding 'lm_eval/tasks/blimp/generate_configs.py' 2026-09-01T00:16:56,599 adding 'lm_eval/tasks/blimp/inchoative.yaml' 2026-09-01T00:16:56,600 adding 'lm_eval/tasks/blimp/intransitive.yaml' 2026-09-01T00:16:56,601 adding 'lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml' 2026-09-01T00:16:56,603 adding 'lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml' 2026-09-01T00:16:56,604 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml' 2026-09-01T00:16:56,605 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml' 2026-09-01T00:16:56,606 adding 'lm_eval/tasks/blimp/left_branch_island_echo_question.yaml' 2026-09-01T00:16:56,607 adding 'lm_eval/tasks/blimp/left_branch_island_simple_question.yaml' 2026-09-01T00:16:56,608 adding 'lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml' 2026-09-01T00:16:56,610 adding 'lm_eval/tasks/blimp/npi_present_1.yaml' 2026-09-01T00:16:56,611 adding 'lm_eval/tasks/blimp/npi_present_2.yaml' 2026-09-01T00:16:56,612 adding 'lm_eval/tasks/blimp/only_npi_licensor_present.yaml' 2026-09-01T00:16:56,613 adding 'lm_eval/tasks/blimp/only_npi_scope.yaml' 2026-09-01T00:16:56,614 adding 'lm_eval/tasks/blimp/passive_1.yaml' 2026-09-01T00:16:56,616 adding 'lm_eval/tasks/blimp/passive_2.yaml' 2026-09-01T00:16:56,617 adding 'lm_eval/tasks/blimp/principle_A_c_command.yaml' 2026-09-01T00:16:56,618 adding 'lm_eval/tasks/blimp/principle_A_case_1.yaml' 2026-09-01T00:16:56,619 adding 'lm_eval/tasks/blimp/principle_A_case_2.yaml' 2026-09-01T00:16:56,620 adding 'lm_eval/tasks/blimp/principle_A_domain_1.yaml' 2026-09-01T00:16:56,621 adding 'lm_eval/tasks/blimp/principle_A_domain_2.yaml' 2026-09-01T00:16:56,622 adding 'lm_eval/tasks/blimp/principle_A_domain_3.yaml' 2026-09-01T00:16:56,623 adding 'lm_eval/tasks/blimp/principle_A_reconstruction.yaml' 2026-09-01T00:16:56,625 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml' 2026-09-01T00:16:56,626 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml' 2026-09-01T00:16:56,627 adding 'lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml' 2026-09-01T00:16:56,628 adding 'lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml' 2026-09-01T00:16:56,629 adding 'lm_eval/tasks/blimp/sentential_subject_island.yaml' 2026-09-01T00:16:56,630 adding 'lm_eval/tasks/blimp/superlative_quantifiers_1.yaml' 2026-09-01T00:16:56,631 adding 'lm_eval/tasks/blimp/superlative_quantifiers_2.yaml' 2026-09-01T00:16:56,632 adding 'lm_eval/tasks/blimp/tough_vs_raising_1.yaml' 2026-09-01T00:16:56,633 adding 'lm_eval/tasks/blimp/tough_vs_raising_2.yaml' 2026-09-01T00:16:56,634 adding 'lm_eval/tasks/blimp/transitive.yaml' 2026-09-01T00:16:56,636 adding 'lm_eval/tasks/blimp/wh_island.yaml' 2026-09-01T00:16:56,637 adding 'lm_eval/tasks/blimp/wh_questions_object_gap.yaml' 2026-09-01T00:16:56,638 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap.yaml' 2026-09-01T00:16:56,639 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml' 2026-09-01T00:16:56,640 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml' 2026-09-01T00:16:56,641 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml' 2026-09-01T00:16:56,642 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml' 2026-09-01T00:16:56,643 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml' 2026-09-01T00:16:56,647 adding 'lm_eval/tasks/blimp_nl/README.md' 2026-09-01T00:16:56,648 adding 'lm_eval/tasks/blimp_nl/_template_yaml' 2026-09-01T00:16:56,649 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_r_extraction.yaml' 2026-09-01T00:16:56,650 adding 'lm_eval/tasks/blimp_nl/adpositional_phrases__argument_scrambling.yaml' 2026-09-01T00:16:56,651 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_proform.yaml' 2026-09-01T00:16:56,653 adding 'lm_eval/tasks/blimp_nl/adverbial_modification__position_type.yaml' 2026-09-01T00:16:56,654 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__number.yaml' 2026-09-01T00:16:56,655 adding 'lm_eval/tasks/blimp_nl/anaphor_agreement__person.yaml' 2026-09-01T00:16:56,656 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_ditransitive.yaml' 2026-09-01T00:16:56,657 adding 'lm_eval/tasks/blimp_nl/argument_structure__argument_number_in_transitive.yaml' 2026-09-01T00:16:56,658 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_1.yaml' 2026-09-01T00:16:56,659 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_2.yaml' 2026-09-01T00:16:56,661 adding 'lm_eval/tasks/blimp_nl/argument_structure__ditransitive_nomdat_3.yaml' 2026-09-01T00:16:56,662 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_1.yaml' 2026-09-01T00:16:56,663 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_2.yaml' 2026-09-01T00:16:56,664 adding 'lm_eval/tasks/blimp_nl/argument_structure__intransitive_unaccusative_3.yaml' 2026-09-01T00:16:56,665 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_1.yaml' 2026-09-01T00:16:56,666 adding 'lm_eval/tasks/blimp_nl/auxiliaries__order_2.yaml' 2026-09-01T00:16:56,668 adding 'lm_eval/tasks/blimp_nl/auxiliaries__perfect.yaml' 2026-09-01T00:16:56,669 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_1.yaml' 2026-09-01T00:16:56,670 adding 'lm_eval/tasks/blimp_nl/auxiliaries__semi_aspectual_2.yaml' 2026-09-01T00:16:56,671 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__c_command.yaml' 2026-09-01T00:16:56,672 adding 'lm_eval/tasks/blimp_nl/binding_principle_a__monomorphemic.yaml' 2026-09-01T00:16:56,674 adding 'lm_eval/tasks/blimp_nl/blimp_nl_group.yaml' 2026-09-01T00:16:56,675 adding 'lm_eval/tasks/blimp_nl/complementive__ditransitive.yaml' 2026-09-01T00:16:56,676 adding 'lm_eval/tasks/blimp_nl/complementive__intransitive.yaml' 2026-09-01T00:16:56,677 adding 'lm_eval/tasks/blimp_nl/complementive__position_adverb.yaml' 2026-09-01T00:16:56,678 adding 'lm_eval/tasks/blimp_nl/complementive__position_verb.yaml' 2026-09-01T00:16:56,679 adding 'lm_eval/tasks/blimp_nl/complementive__transitive.yaml' 2026-09-01T00:16:56,681 adding 'lm_eval/tasks/blimp_nl/crossing_dependencies__cross_dependency.yaml' 2026-09-01T00:16:56,682 adding 'lm_eval/tasks/blimp_nl/determiners__geen_expletive.yaml' 2026-09-01T00:16:56,683 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_1.yaml' 2026-09-01T00:16:56,684 adding 'lm_eval/tasks/blimp_nl/determiners__geen_scrambling_2.yaml' 2026-09-01T00:16:56,685 adding 'lm_eval/tasks/blimp_nl/determiners__negative_polarity.yaml' 2026-09-01T00:16:56,686 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_adverbial.yaml' 2026-09-01T00:16:56,687 adding 'lm_eval/tasks/blimp_nl/extraposition__adjectival_supplementive.yaml' 2026-09-01T00:16:56,688 adding 'lm_eval/tasks/blimp_nl/extraposition__argument_nominal.yaml' 2026-09-01T00:16:56,690 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__complementizer.yaml' 2026-09-01T00:16:56,691 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_dat.yaml' 2026-09-01T00:16:56,692 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__perception_of.yaml' 2026-09-01T00:16:56,693 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__position.yaml' 2026-09-01T00:16:56,694 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_1.yaml' 2026-09-01T00:16:56,695 adding 'lm_eval/tasks/blimp_nl/finite_argument_clause__sluicing_2.yaml' 2026-09-01T00:16:56,696 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_cluster.yaml' 2026-09-01T00:16:56,698 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_1.yaml' 2026-09-01T00:16:56,699 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_2.yaml' 2026-09-01T00:16:56,700 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__bare_verb_type_3.yaml' 2026-09-01T00:16:56,701 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__om_te.yaml' 2026-09-01T00:16:56,702 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_1.yaml' 2026-09-01T00:16:56,703 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_om_te_difference_2.yaml' 2026-09-01T00:16:56,705 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__te_transparant_split.yaml' 2026-09-01T00:16:56,706 adding 'lm_eval/tasks/blimp_nl/infinitival_argument_clause__verb_type.yaml' 2026-09-01T00:16:56,707 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_1.yaml' 2026-09-01T00:16:56,708 adding 'lm_eval/tasks/blimp_nl/nominalization__type_inf_2.yaml' 2026-09-01T00:16:56,709 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__scrambling.yaml' 2026-09-01T00:16:56,710 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_1.yaml' 2026-09-01T00:16:56,712 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_2.yaml' 2026-09-01T00:16:56,713 adding 'lm_eval/tasks/blimp_nl/parasitic_gaps__structure_type_3.yaml' 2026-09-01T00:16:56,714 adding 'lm_eval/tasks/blimp_nl/passive__aci.yaml' 2026-09-01T00:16:56,715 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_1.yaml' 2026-09-01T00:16:56,716 adding 'lm_eval/tasks/blimp_nl/passive__ditransitive_2.yaml' 2026-09-01T00:16:56,717 adding 'lm_eval/tasks/blimp_nl/passive__impersonal.yaml' 2026-09-01T00:16:56,719 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_plural.yaml' 2026-09-01T00:16:56,720 adding 'lm_eval/tasks/blimp_nl/quantifiers__universal_difference_agreement_singular.yaml' 2026-09-01T00:16:56,721 adding 'lm_eval/tasks/blimp_nl/r_words__adverbial.yaml' 2026-09-01T00:16:56,722 adding 'lm_eval/tasks/blimp_nl/r_words__weak_proform.yaml' 2026-09-01T00:16:56,723 adding 'lm_eval/tasks/blimp_nl/relativization__island.yaml' 2026-09-01T00:16:56,724 adding 'lm_eval/tasks/blimp_nl/relativization__pied_piping.yaml' 2026-09-01T00:16:56,725 adding 'lm_eval/tasks/blimp_nl/relativization__resumptive_prolepsis.yaml' 2026-09-01T00:16:56,727 adding 'lm_eval/tasks/blimp_nl/topicalization__island.yaml' 2026-09-01T00:16:56,728 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_1.yaml' 2026-09-01T00:16:56,729 adding 'lm_eval/tasks/blimp_nl/topicalization__question_similarity_2.yaml' 2026-09-01T00:16:56,730 adding 'lm_eval/tasks/blimp_nl/topicalization__resumptive_prolepsis.yaml' 2026-09-01T00:16:56,731 adding 'lm_eval/tasks/blimp_nl/verb_second__order_embedded.yaml' 2026-09-01T00:16:56,732 adding 'lm_eval/tasks/blimp_nl/verb_second__order_main.yaml' 2026-09-01T00:16:56,733 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_gap.yaml' 2026-09-01T00:16:56,734 adding 'lm_eval/tasks/blimp_nl/wh_movement__filler_effect_no_gap.yaml' 2026-09-01T00:16:56,735 adding 'lm_eval/tasks/blimp_nl/wh_movement__hierarchy.yaml' 2026-09-01T00:16:56,737 adding 'lm_eval/tasks/blimp_nl/wh_movement__question_formation.yaml' 2026-09-01T00:16:56,738 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml' 2026-09-01T00:16:56,739 adding 'lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml' 2026-09-01T00:16:56,740 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml' 2026-09-01T00:16:56,741 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml' 2026-09-01T00:16:56,742 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml' 2026-09-01T00:16:56,743 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml' 2026-09-01T00:16:56,744 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml' 2026-09-01T00:16:56,746 adding 'lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml' 2026-09-01T00:16:56,747 adding 'lm_eval/tasks/c4/README.md' 2026-09-01T00:16:56,748 adding 'lm_eval/tasks/c4/c4.yaml' 2026-09-01T00:16:56,750 adding 'lm_eval/tasks/c4/preprocess_c4.py' 2026-09-01T00:16:56,752 adding 'lm_eval/tasks/cabbq/README.md' 2026-09-01T00:16:56,753 adding 'lm_eval/tasks/cabbq/_cabbq_common_yaml' 2026-09-01T00:16:56,754 adding 'lm_eval/tasks/cabbq/cabbq.yaml' 2026-09-01T00:16:56,755 adding 'lm_eval/tasks/cabbq/cabbq_age.yaml' 2026-09-01T00:16:56,757 adding 'lm_eval/tasks/cabbq/cabbq_disability_status.yaml' 2026-09-01T00:16:56,758 adding 'lm_eval/tasks/cabbq/cabbq_gender.yaml' 2026-09-01T00:16:56,759 adding 'lm_eval/tasks/cabbq/cabbq_lgbtqia.yaml' 2026-09-01T00:16:56,760 adding 'lm_eval/tasks/cabbq/cabbq_nationality.yaml' 2026-09-01T00:16:56,761 adding 'lm_eval/tasks/cabbq/cabbq_physical_appearance.yaml' 2026-09-01T00:16:56,762 adding 'lm_eval/tasks/cabbq/cabbq_race_ethnicity.yaml' 2026-09-01T00:16:56,764 adding 'lm_eval/tasks/cabbq/cabbq_religion.yaml' 2026-09-01T00:16:56,765 adding 'lm_eval/tasks/cabbq/cabbq_ses.yaml' 2026-09-01T00:16:56,766 adding 'lm_eval/tasks/cabbq/cabbq_spanish_region.yaml' 2026-09-01T00:16:56,768 adding 'lm_eval/tasks/cabbq/utils.py' 2026-09-01T00:16:56,770 adding 'lm_eval/tasks/careqa/README.md' 2026-09-01T00:16:56,771 adding 'lm_eval/tasks/careqa/careqa_en.yaml' 2026-09-01T00:16:56,772 adding 'lm_eval/tasks/careqa/careqa_es.yaml' 2026-09-01T00:16:56,773 adding 'lm_eval/tasks/careqa/careqa_open.yaml' 2026-09-01T00:16:56,775 adding 'lm_eval/tasks/careqa/careqa_open_perplexity.yaml' 2026-09-01T00:16:56,776 adding 'lm_eval/tasks/careqa/utils.py' 2026-09-01T00:16:56,777 adding 'lm_eval/tasks/careqa/utils_open.py' 2026-09-01T00:16:56,779 adding 'lm_eval/tasks/careqa/utils_perplexity.py' 2026-09-01T00:16:56,782 adding 'lm_eval/tasks/catalan_bench/README.md' 2026-09-01T00:16:56,783 adding 'lm_eval/tasks/catalan_bench/_arc_ca_common_yaml' 2026-09-01T00:16:56,784 adding 'lm_eval/tasks/catalan_bench/_cabreu_common_yaml' 2026-09-01T00:16:56,785 adding 'lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml' 2026-09-01T00:16:56,786 adding 'lm_eval/tasks/catalan_bench/arc_ca_easy.yaml' 2026-09-01T00:16:56,788 adding 'lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml' 2026-09-01T00:16:56,789 adding 'lm_eval/tasks/catalan_bench/cabreu_extractive.yaml' 2026-09-01T00:16:56,790 adding 'lm_eval/tasks/catalan_bench/cabreu_extreme.yaml' 2026-09-01T00:16:56,791 adding 'lm_eval/tasks/catalan_bench/catalan_bench.yaml' 2026-09-01T00:16:56,792 adding 'lm_eval/tasks/catalan_bench/catalanqa.yaml' 2026-09-01T00:16:56,793 adding 'lm_eval/tasks/catalan_bench/catcola.yaml' 2026-09-01T00:16:56,794 adding 'lm_eval/tasks/catalan_bench/cocoteros_va.yaml' 2026-09-01T00:16:56,796 adding 'lm_eval/tasks/catalan_bench/copa_ca.yaml' 2026-09-01T00:16:56,797 adding 'lm_eval/tasks/catalan_bench/coqcat.yaml' 2026-09-01T00:16:56,798 adding 'lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml' 2026-09-01T00:16:56,799 adding 'lm_eval/tasks/catalan_bench/openbookqa_ca.yaml' 2026-09-01T00:16:56,800 adding 'lm_eval/tasks/catalan_bench/parafraseja.yaml' 2026-09-01T00:16:56,801 adding 'lm_eval/tasks/catalan_bench/paws_ca.yaml' 2026-09-01T00:16:56,803 adding 'lm_eval/tasks/catalan_bench/piqa_ca.yaml' 2026-09-01T00:16:56,804 adding 'lm_eval/tasks/catalan_bench/siqa_ca.yaml' 2026-09-01T00:16:56,805 adding 'lm_eval/tasks/catalan_bench/teca.yaml' 2026-09-01T00:16:56,806 adding 'lm_eval/tasks/catalan_bench/terretaqa.yaml' 2026-09-01T00:16:56,808 adding 'lm_eval/tasks/catalan_bench/utils.py' 2026-09-01T00:16:56,809 adding 'lm_eval/tasks/catalan_bench/wnli_ca.yaml' 2026-09-01T00:16:56,810 adding 'lm_eval/tasks/catalan_bench/xnli_ca.yaml' 2026-09-01T00:16:56,811 adding 'lm_eval/tasks/catalan_bench/xnli_va.yaml' 2026-09-01T00:16:56,813 adding 'lm_eval/tasks/catalan_bench/xquad_ca.yaml' 2026-09-01T00:16:56,814 adding 'lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml' 2026-09-01T00:16:56,816 adding 'lm_eval/tasks/catalan_bench/cieacova/cieacova.yaml' 2026-09-01T00:16:56,817 adding 'lm_eval/tasks/catalan_bench/cieacova/cieacova_choice.yaml' 2026-09-01T00:16:56,819 adding 'lm_eval/tasks/catalan_bench/cieacova/cieacova_word.yaml' 2026-09-01T00:16:56,820 adding 'lm_eval/tasks/catalan_bench/cieacova/utils.py' 2026-09-01T00:16:56,822 adding 'lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml' 2026-09-01T00:16:56,824 adding 'lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py' 2026-09-01T00:16:56,825 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml' 2026-09-01T00:16:56,826 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml' 2026-09-01T00:16:56,828 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml' 2026-09-01T00:16:56,829 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml' 2026-09-01T00:16:56,830 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml' 2026-09-01T00:16:56,831 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml' 2026-09-01T00:16:56,832 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml' 2026-09-01T00:16:56,833 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml' 2026-09-01T00:16:56,835 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml' 2026-09-01T00:16:56,836 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml' 2026-09-01T00:16:56,837 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml' 2026-09-01T00:16:56,838 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml' 2026-09-01T00:16:56,839 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml' 2026-09-01T00:16:56,840 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml' 2026-09-01T00:16:56,842 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml' 2026-09-01T00:16:56,843 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml' 2026-09-01T00:16:56,844 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml' 2026-09-01T00:16:56,846 adding 'lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common' 2026-09-01T00:16:56,848 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml' 2026-09-01T00:16:56,849 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml' 2026-09-01T00:16:56,850 adding 'lm_eval/tasks/catalan_bench/truthfulqa_va/truthfulqa_va.yaml' 2026-09-01T00:16:56,852 adding 'lm_eval/tasks/catalan_bench/truthfulqa_va/utils.py' 2026-09-01T00:16:56,856 adding 'lm_eval/tasks/ceval/README.md' 2026-09-01T00:16:56,857 adding 'lm_eval/tasks/ceval/_ceval-valid.yaml' 2026-09-01T00:16:56,859 adding 'lm_eval/tasks/ceval/_default_ceval_yaml' 2026-09-01T00:16:56,860 adding 'lm_eval/tasks/ceval/_generate_configs.py' 2026-09-01T00:16:56,861 adding 'lm_eval/tasks/ceval/ceval-valid_accountant.yaml' 2026-09-01T00:16:56,863 adding 'lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml' 2026-09-01T00:16:56,864 adding 'lm_eval/tasks/ceval/ceval-valid_art_studies.yaml' 2026-09-01T00:16:56,865 adding 'lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml' 2026-09-01T00:16:56,866 adding 'lm_eval/tasks/ceval/ceval-valid_business_administration.yaml' 2026-09-01T00:16:56,867 adding 'lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml' 2026-09-01T00:16:56,868 adding 'lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml' 2026-09-01T00:16:56,869 adding 'lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml' 2026-09-01T00:16:56,871 adding 'lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml' 2026-09-01T00:16:56,872 adding 'lm_eval/tasks/ceval/ceval-valid_college_economics.yaml' 2026-09-01T00:16:56,873 adding 'lm_eval/tasks/ceval/ceval-valid_college_physics.yaml' 2026-09-01T00:16:56,874 adding 'lm_eval/tasks/ceval/ceval-valid_college_programming.yaml' 2026-09-01T00:16:56,875 adding 'lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml' 2026-09-01T00:16:56,876 adding 'lm_eval/tasks/ceval/ceval-valid_computer_network.yaml' 2026-09-01T00:16:56,878 adding 'lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml' 2026-09-01T00:16:56,879 adding 'lm_eval/tasks/ceval/ceval-valid_education_science.yaml' 2026-09-01T00:16:56,880 adding 'lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml' 2026-09-01T00:16:56,881 adding 'lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml' 2026-09-01T00:16:56,882 adding 'lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml' 2026-09-01T00:16:56,883 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml' 2026-09-01T00:16:56,885 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml' 2026-09-01T00:16:56,886 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml' 2026-09-01T00:16:56,887 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml' 2026-09-01T00:16:56,888 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml' 2026-09-01T00:16:56,890 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml' 2026-09-01T00:16:56,891 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml' 2026-09-01T00:16:56,892 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml' 2026-09-01T00:16:56,893 adding 'lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml' 2026-09-01T00:16:56,895 adding 'lm_eval/tasks/ceval/ceval-valid_law.yaml' 2026-09-01T00:16:56,896 adding 'lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml' 2026-09-01T00:16:56,897 adding 'lm_eval/tasks/ceval/ceval-valid_logic.yaml' 2026-09-01T00:16:56,898 adding 'lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml' 2026-09-01T00:16:56,900 adding 'lm_eval/tasks/ceval/ceval-valid_marxism.yaml' 2026-09-01T00:16:56,901 adding 'lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml' 2026-09-01T00:16:56,902 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml' 2026-09-01T00:16:56,904 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml' 2026-09-01T00:16:56,905 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml' 2026-09-01T00:16:56,906 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml' 2026-09-01T00:16:56,907 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml' 2026-09-01T00:16:56,908 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml' 2026-09-01T00:16:56,910 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml' 2026-09-01T00:16:56,911 adding 'lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml' 2026-09-01T00:16:56,912 adding 'lm_eval/tasks/ceval/ceval-valid_operating_system.yaml' 2026-09-01T00:16:56,913 adding 'lm_eval/tasks/ceval/ceval-valid_physician.yaml' 2026-09-01T00:16:56,914 adding 'lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml' 2026-09-01T00:16:56,915 adding 'lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml' 2026-09-01T00:16:56,916 adding 'lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml' 2026-09-01T00:16:56,917 adding 'lm_eval/tasks/ceval/ceval-valid_sports_science.yaml' 2026-09-01T00:16:56,918 adding 'lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml' 2026-09-01T00:16:56,920 adding 'lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml' 2026-09-01T00:16:56,921 adding 'lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml' 2026-09-01T00:16:56,922 adding 'lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml' 2026-09-01T00:16:56,924 adding 'lm_eval/tasks/chartqa/README.md' 2026-09-01T00:16:56,925 adding 'lm_eval/tasks/chartqa/chartqa.yaml' 2026-09-01T00:16:56,926 adding 'lm_eval/tasks/chartqa/chartqa_llama.yaml' 2026-09-01T00:16:56,927 adding 'lm_eval/tasks/chartqa/chartqa_llama_90.yaml' 2026-09-01T00:16:56,929 adding 'lm_eval/tasks/chartqa/utils.py' 2026-09-01T00:16:56,931 adding 'lm_eval/tasks/click/README.md' 2026-09-01T00:16:56,932 adding 'lm_eval/tasks/click/click.yaml' 2026-09-01T00:16:56,934 adding 'lm_eval/tasks/click/click_cul/_click_cul.yaml' 2026-09-01T00:16:56,935 adding 'lm_eval/tasks/click/click_cul/_default_click_cul_yaml' 2026-09-01T00:16:56,936 adding 'lm_eval/tasks/click/click_cul/click_cul_economy.yaml' 2026-09-01T00:16:56,937 adding 'lm_eval/tasks/click/click_cul/click_cul_geography.yaml' 2026-09-01T00:16:56,939 adding 'lm_eval/tasks/click/click_cul/click_cul_history.yaml' 2026-09-01T00:16:56,940 adding 'lm_eval/tasks/click/click_cul/click_cul_kpop.yaml' 2026-09-01T00:16:56,941 adding 'lm_eval/tasks/click/click_cul/click_cul_law.yaml' 2026-09-01T00:16:56,942 adding 'lm_eval/tasks/click/click_cul/click_cul_politics.yaml' 2026-09-01T00:16:56,943 adding 'lm_eval/tasks/click/click_cul/click_cul_society.yaml' 2026-09-01T00:16:56,944 adding 'lm_eval/tasks/click/click_cul/click_cul_tradition.yaml' 2026-09-01T00:16:56,946 adding 'lm_eval/tasks/click/click_cul/utils.py' 2026-09-01T00:16:56,947 adding 'lm_eval/tasks/click/click_lang/_click_lang.yaml' 2026-09-01T00:16:56,948 adding 'lm_eval/tasks/click/click_lang/_default_click_lang_yaml' 2026-09-01T00:16:56,950 adding 'lm_eval/tasks/click/click_lang/click_lang_function.yaml' 2026-09-01T00:16:56,951 adding 'lm_eval/tasks/click/click_lang/click_lang_grammar.yaml' 2026-09-01T00:16:56,952 adding 'lm_eval/tasks/click/click_lang/click_lang_text.yaml' 2026-09-01T00:16:56,953 adding 'lm_eval/tasks/click/click_lang/utils.py' 2026-09-01T00:16:56,956 adding 'lm_eval/tasks/cmmlu/README.md' 2026-09-01T00:16:56,958 adding 'lm_eval/tasks/cmmlu/_cmmlu.yaml' 2026-09-01T00:16:56,959 adding 'lm_eval/tasks/cmmlu/_default_template_yaml' 2026-09-01T00:16:56,961 adding 'lm_eval/tasks/cmmlu/_generate_configs.py' 2026-09-01T00:16:56,962 adding 'lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml' 2026-09-01T00:16:56,963 adding 'lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml' 2026-09-01T00:16:56,964 adding 'lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml' 2026-09-01T00:16:56,965 adding 'lm_eval/tasks/cmmlu/cmmlu_arts.yaml' 2026-09-01T00:16:56,966 adding 'lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml' 2026-09-01T00:16:56,968 adding 'lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml' 2026-09-01T00:16:56,969 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml' 2026-09-01T00:16:56,970 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml' 2026-09-01T00:16:56,971 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml' 2026-09-01T00:16:56,972 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml' 2026-09-01T00:16:56,973 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml' 2026-09-01T00:16:56,974 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml' 2026-09-01T00:16:56,975 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml' 2026-09-01T00:16:56,977 adding 'lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml' 2026-09-01T00:16:56,978 adding 'lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml' 2026-09-01T00:16:56,979 adding 'lm_eval/tasks/cmmlu/cmmlu_college_education.yaml' 2026-09-01T00:16:56,980 adding 'lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml' 2026-09-01T00:16:56,981 adding 'lm_eval/tasks/cmmlu/cmmlu_college_law.yaml' 2026-09-01T00:16:56,982 adding 'lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml' 2026-09-01T00:16:56,984 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml' 2026-09-01T00:16:56,985 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml' 2026-09-01T00:16:56,986 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml' 2026-09-01T00:16:56,987 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml' 2026-09-01T00:16:56,988 adding 'lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml' 2026-09-01T00:16:56,989 adding 'lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml' 2026-09-01T00:16:56,991 adding 'lm_eval/tasks/cmmlu/cmmlu_economics.yaml' 2026-09-01T00:16:56,992 adding 'lm_eval/tasks/cmmlu/cmmlu_education.yaml' 2026-09-01T00:16:56,993 adding 'lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml' 2026-09-01T00:16:56,994 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml' 2026-09-01T00:16:56,995 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml' 2026-09-01T00:16:56,996 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml' 2026-09-01T00:16:56,998 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml' 2026-09-01T00:16:56,999 adding 'lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml' 2026-09-01T00:16:57,000 adding 'lm_eval/tasks/cmmlu/cmmlu_food_science.yaml' 2026-09-01T00:16:57,001 adding 'lm_eval/tasks/cmmlu/cmmlu_genetics.yaml' 2026-09-01T00:16:57,002 adding 'lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml' 2026-09-01T00:16:57,003 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml' 2026-09-01T00:16:57,005 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml' 2026-09-01T00:16:57,006 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml' 2026-09-01T00:16:57,007 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml' 2026-09-01T00:16:57,008 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml' 2026-09-01T00:16:57,009 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml' 2026-09-01T00:16:57,011 adding 'lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml' 2026-09-01T00:16:57,012 adding 'lm_eval/tasks/cmmlu/cmmlu_international_law.yaml' 2026-09-01T00:16:57,013 adding 'lm_eval/tasks/cmmlu/cmmlu_journalism.yaml' 2026-09-01T00:16:57,014 adding 'lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml' 2026-09-01T00:16:57,015 adding 'lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml' 2026-09-01T00:16:57,017 adding 'lm_eval/tasks/cmmlu/cmmlu_logical.yaml' 2026-09-01T00:16:57,018 adding 'lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml' 2026-09-01T00:16:57,019 adding 'lm_eval/tasks/cmmlu/cmmlu_management.yaml' 2026-09-01T00:16:57,020 adding 'lm_eval/tasks/cmmlu/cmmlu_marketing.yaml' 2026-09-01T00:16:57,021 adding 'lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml' 2026-09-01T00:16:57,023 adding 'lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml' 2026-09-01T00:16:57,024 adding 'lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml' 2026-09-01T00:16:57,025 adding 'lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml' 2026-09-01T00:16:57,026 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml' 2026-09-01T00:16:57,028 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml' 2026-09-01T00:16:57,029 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml' 2026-09-01T00:16:57,030 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml' 2026-09-01T00:16:57,031 adding 'lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml' 2026-09-01T00:16:57,032 adding 'lm_eval/tasks/cmmlu/cmmlu_security_study.yaml' 2026-09-01T00:16:57,033 adding 'lm_eval/tasks/cmmlu/cmmlu_sociology.yaml' 2026-09-01T00:16:57,034 adding 'lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml' 2026-09-01T00:16:57,035 adding 'lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml' 2026-09-01T00:16:57,036 adding 'lm_eval/tasks/cmmlu/cmmlu_virology.yaml' 2026-09-01T00:16:57,038 adding 'lm_eval/tasks/cmmlu/cmmlu_world_history.yaml' 2026-09-01T00:16:57,039 adding 'lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml' 2026-09-01T00:16:57,040 adding 'lm_eval/tasks/cnn_dailymail/README.md' 2026-09-01T00:16:57,042 adding 'lm_eval/tasks/cnn_dailymail/cnn_dailymail.yaml' 2026-09-01T00:16:57,043 adding 'lm_eval/tasks/cnn_dailymail/utils.py' 2026-09-01T00:16:57,046 adding 'lm_eval/tasks/code_x_glue/code-text/README.md' 2026-09-01T00:16:57,047 adding 'lm_eval/tasks/code_x_glue/code-text/_codexglue.yaml' 2026-09-01T00:16:57,048 adding 'lm_eval/tasks/code_x_glue/code-text/_default_template_yaml' 2026-09-01T00:16:57,050 adding 'lm_eval/tasks/code_x_glue/code-text/bleu.py' 2026-09-01T00:16:57,051 adding 'lm_eval/tasks/code_x_glue/code-text/go.yaml' 2026-09-01T00:16:57,052 adding 'lm_eval/tasks/code_x_glue/code-text/java.yaml' 2026-09-01T00:16:57,053 adding 'lm_eval/tasks/code_x_glue/code-text/javascript.yaml' 2026-09-01T00:16:57,054 adding 'lm_eval/tasks/code_x_glue/code-text/php.yaml' 2026-09-01T00:16:57,056 adding 'lm_eval/tasks/code_x_glue/code-text/python.yaml' 2026-09-01T00:16:57,057 adding 'lm_eval/tasks/code_x_glue/code-text/ruby.yaml' 2026-09-01T00:16:57,058 adding 'lm_eval/tasks/code_x_glue/code-text/utils.py' 2026-09-01T00:16:57,059 adding 'lm_eval/tasks/common_voice/common_voice_en.yaml' 2026-09-01T00:16:57,061 adding 'lm_eval/tasks/common_voice/utils.py' 2026-09-01T00:16:57,063 adding 'lm_eval/tasks/commonsense_qa/README.md' 2026-09-01T00:16:57,064 adding 'lm_eval/tasks/commonsense_qa/default.yaml' 2026-09-01T00:16:57,066 adding 'lm_eval/tasks/copal_id/README.md' 2026-09-01T00:16:57,067 adding 'lm_eval/tasks/copal_id/colloquial.yaml' 2026-09-01T00:16:57,068 adding 'lm_eval/tasks/copal_id/standard.yaml' 2026-09-01T00:16:57,069 adding 'lm_eval/tasks/copal_id/utils.py' 2026-09-01T00:16:57,071 adding 'lm_eval/tasks/coqa/README.md' 2026-09-01T00:16:57,072 adding 'lm_eval/tasks/coqa/default.yaml' 2026-09-01T00:16:57,074 adding 'lm_eval/tasks/coqa/utils.py' 2026-09-01T00:16:57,076 adding 'lm_eval/tasks/crows_pairs/README.md' 2026-09-01T00:16:57,078 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english.yaml' 2026-09-01T00:16:57,079 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml' 2026-09-01T00:16:57,080 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml' 2026-09-01T00:16:57,081 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml' 2026-09-01T00:16:57,082 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml' 2026-09-01T00:16:57,083 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml' 2026-09-01T00:16:57,084 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml' 2026-09-01T00:16:57,086 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml' 2026-09-01T00:16:57,087 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml' 2026-09-01T00:16:57,088 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml' 2026-09-01T00:16:57,089 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml' 2026-09-01T00:16:57,090 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french.yaml' 2026-09-01T00:16:57,091 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml' 2026-09-01T00:16:57,092 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml' 2026-09-01T00:16:57,093 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml' 2026-09-01T00:16:57,094 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml' 2026-09-01T00:16:57,096 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml' 2026-09-01T00:16:57,097 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml' 2026-09-01T00:16:57,098 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml' 2026-09-01T00:16:57,099 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml' 2026-09-01T00:16:57,100 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml' 2026-09-01T00:16:57,101 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml' 2026-09-01T00:16:57,102 adding 'lm_eval/tasks/crows_pairs/utils.py' 2026-09-01T00:16:57,104 adding 'lm_eval/tasks/cruxeval/README.md' 2026-09-01T00:16:57,105 adding 'lm_eval/tasks/cruxeval/cruxeval_common_yaml' 2026-09-01T00:16:57,107 adding 'lm_eval/tasks/cruxeval/cruxeval_input.yaml' 2026-09-01T00:16:57,108 adding 'lm_eval/tasks/cruxeval/cruxeval_input_08.yaml' 2026-09-01T00:16:57,109 adding 'lm_eval/tasks/cruxeval/cruxeval_input_cot.yaml' 2026-09-01T00:16:57,110 adding 'lm_eval/tasks/cruxeval/cruxeval_output.yaml' 2026-09-01T00:16:57,111 adding 'lm_eval/tasks/cruxeval/cruxeval_output_08.yaml' 2026-09-01T00:16:57,113 adding 'lm_eval/tasks/cruxeval/cruxeval_output_cot.yaml' 2026-09-01T00:16:57,115 adding 'lm_eval/tasks/cruxeval/utils.py' 2026-09-01T00:16:57,117 adding 'lm_eval/tasks/csatqa/_csatqa.yaml' 2026-09-01T00:16:57,118 adding 'lm_eval/tasks/csatqa/_default_csatqa_yaml' 2026-09-01T00:16:57,119 adding 'lm_eval/tasks/csatqa/_generate_configs.py' 2026-09-01T00:16:57,120 adding 'lm_eval/tasks/csatqa/csatqa_gr.yaml' 2026-09-01T00:16:57,121 adding 'lm_eval/tasks/csatqa/csatqa_li.yaml' 2026-09-01T00:16:57,122 adding 'lm_eval/tasks/csatqa/csatqa_rch.yaml' 2026-09-01T00:16:57,124 adding 'lm_eval/tasks/csatqa/csatqa_rcs.yaml' 2026-09-01T00:16:57,125 adding 'lm_eval/tasks/csatqa/csatqa_rcss.yaml' 2026-09-01T00:16:57,126 adding 'lm_eval/tasks/csatqa/csatqa_wr.yaml' 2026-09-01T00:16:57,127 adding 'lm_eval/tasks/csatqa/utils.py' 2026-09-01T00:16:57,129 adding 'lm_eval/tasks/darija_bench/README.md' 2026-09-01T00:16:57,131 adding 'lm_eval/tasks/darija_bench/darija_sentiment/README.md' 2026-09-01T00:16:57,132 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment.yaml' 2026-09-01T00:16:57,133 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_electrom.yaml' 2026-09-01T00:16:57,135 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_mac.yaml' 2026-09-01T00:16:57,136 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msac.yaml' 2026-09-01T00:16:57,137 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_msda.yaml' 2026-09-01T00:16:57,138 adding 'lm_eval/tasks/darija_bench/darija_sentiment/darija_sentiment_myc.yaml' 2026-09-01T00:16:57,139 adding 'lm_eval/tasks/darija_bench/darija_sentiment/default_darija_sentiment_template_yaml' 2026-09-01T00:16:57,141 adding 'lm_eval/tasks/darija_bench/darija_sentiment/utils.py' 2026-09-01T00:16:57,143 adding 'lm_eval/tasks/darija_bench/darija_summarization/README.md' 2026-09-01T00:16:57,144 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization.yaml' 2026-09-01T00:16:57,145 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_common_yaml' 2026-09-01T00:16:57,147 adding 'lm_eval/tasks/darija_bench/darija_summarization/summarization_darija.yaml' 2026-09-01T00:16:57,148 adding 'lm_eval/tasks/darija_bench/darija_summarization/utils.py' 2026-09-01T00:16:57,150 adding 'lm_eval/tasks/darija_bench/darija_translation/README.md' 2026-09-01T00:16:57,152 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_common_yaml' 2026-09-01T00:16:57,153 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_all.yaml' 2026-09-01T00:16:57,154 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_darija.yaml' 2026-09-01T00:16:57,155 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_en.yaml' 2026-09-01T00:16:57,156 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_fr.yaml' 2026-09-01T00:16:57,157 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_dr_msa.yaml' 2026-09-01T00:16:57,158 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_en_dr.yaml' 2026-09-01T00:16:57,160 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_fr_dr.yaml' 2026-09-01T00:16:57,161 adding 'lm_eval/tasks/darija_bench/darija_translation/doda_translation_msa_dr.yaml' 2026-09-01T00:16:57,162 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_common_yaml' 2026-09-01T00:16:57,163 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_all.yaml' 2026-09-01T00:16:57,164 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_darija.yaml' 2026-09-01T00:16:57,166 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_en.yaml' 2026-09-01T00:16:57,167 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_fr.yaml' 2026-09-01T00:16:57,168 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_dr_msa.yaml' 2026-09-01T00:16:57,169 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_en_dr.yaml' 2026-09-01T00:16:57,170 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_fr_dr.yaml' 2026-09-01T00:16:57,171 adding 'lm_eval/tasks/darija_bench/darija_translation/flores_translation_msa_dr.yaml' 2026-09-01T00:16:57,172 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_common_yaml' 2026-09-01T00:16:57,174 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_all.yaml' 2026-09-01T00:16:57,175 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_darija.yaml' 2026-09-01T00:16:57,176 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_dr_msa.yaml' 2026-09-01T00:16:57,177 adding 'lm_eval/tasks/darija_bench/darija_translation/madar_translation_msa_dr.yaml' 2026-09-01T00:16:57,178 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_common_yaml' 2026-09-01T00:16:57,180 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_all.yaml' 2026-09-01T00:16:57,181 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_darija.yaml' 2026-09-01T00:16:57,182 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_dr_en.yaml' 2026-09-01T00:16:57,183 adding 'lm_eval/tasks/darija_bench/darija_translation/seed_translation_en_dr.yaml' 2026-09-01T00:16:57,184 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_common_yaml' 2026-09-01T00:16:57,186 adding 'lm_eval/tasks/darija_bench/darija_translation/translation_darija.yaml' 2026-09-01T00:16:57,187 adding 'lm_eval/tasks/darija_bench/darija_translation/utils.py' 2026-09-01T00:16:57,189 adding 'lm_eval/tasks/darija_bench/darija_transliteration/README.md' 2026-09-01T00:16:57,190 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_ar_dr.yaml' 2026-09-01T00:16:57,191 adding 'lm_eval/tasks/darija_bench/darija_transliteration/translation_dr_ar.yaml' 2026-09-01T00:16:57,193 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_all.yaml' 2026-09-01T00:16:57,194 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_common_yaml' 2026-09-01T00:16:57,195 adding 'lm_eval/tasks/darija_bench/darija_transliteration/transliteration_darija.yaml' 2026-09-01T00:16:57,196 adding 'lm_eval/tasks/darija_bench/darija_transliteration/utils.py' 2026-09-01T00:16:57,198 adding 'lm_eval/tasks/darijahellaswag/README.md' 2026-09-01T00:16:57,200 adding 'lm_eval/tasks/darijahellaswag/darijahellaswag.yaml' 2026-09-01T00:16:57,201 adding 'lm_eval/tasks/darijahellaswag/utils.py' 2026-09-01T00:16:57,203 adding 'lm_eval/tasks/darijammlu/README.md' 2026-09-01T00:16:57,205 adding 'lm_eval/tasks/darijammlu/_darijammlu.yaml' 2026-09-01T00:16:57,206 adding 'lm_eval/tasks/darijammlu/_darijammlu_ar_mmlu.yaml' 2026-09-01T00:16:57,207 adding 'lm_eval/tasks/darijammlu/_darijammlu_mmlu.yaml' 2026-09-01T00:16:57,208 adding 'lm_eval/tasks/darijammlu/_default_darijammlu_template_yaml' 2026-09-01T00:16:57,209 adding 'lm_eval/tasks/darijammlu/_generate_configs.py' 2026-09-01T00:16:57,210 adding 'lm_eval/tasks/darijammlu/darijammlu_accounting.yaml' 2026-09-01T00:16:57,211 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language.yaml' 2026-09-01T00:16:57,213 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(general).yaml' 2026-09-01T00:16:57,214 adding 'lm_eval/tasks/darijammlu/darijammlu_arabic_language_(grammar).yaml' 2026-09-01T00:16:57,215 adding 'lm_eval/tasks/darijammlu/darijammlu_biology.yaml' 2026-09-01T00:16:57,216 adding 'lm_eval/tasks/darijammlu/darijammlu_civics.yaml' 2026-09-01T00:16:57,217 adding 'lm_eval/tasks/darijammlu/darijammlu_computer_science.yaml' 2026-09-01T00:16:57,218 adding 'lm_eval/tasks/darijammlu/darijammlu_driving_test.yaml' 2026-09-01T00:16:57,219 adding 'lm_eval/tasks/darijammlu/darijammlu_economics.yaml' 2026-09-01T00:16:57,221 adding 'lm_eval/tasks/darijammlu/darijammlu_general_knowledge.yaml' 2026-09-01T00:16:57,222 adding 'lm_eval/tasks/darijammlu/darijammlu_geography.yaml' 2026-09-01T00:16:57,223 adding 'lm_eval/tasks/darijammlu/darijammlu_global_facts.yaml' 2026-09-01T00:16:57,224 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_european_history.yaml' 2026-09-01T00:16:57,225 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_geography.yaml' 2026-09-01T00:16:57,226 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_government_and_politics.yaml' 2026-09-01T00:16:57,227 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_psychology.yaml' 2026-09-01T00:16:57,229 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_statistics.yaml' 2026-09-01T00:16:57,230 adding 'lm_eval/tasks/darijammlu/darijammlu_high_school_world_history.yaml' 2026-09-01T00:16:57,231 adding 'lm_eval/tasks/darijammlu/darijammlu_history.yaml' 2026-09-01T00:16:57,232 adding 'lm_eval/tasks/darijammlu/darijammlu_human_aging.yaml' 2026-09-01T00:16:57,233 adding 'lm_eval/tasks/darijammlu/darijammlu_international_law.yaml' 2026-09-01T00:16:57,234 adding 'lm_eval/tasks/darijammlu/darijammlu_islamic_studies.yaml' 2026-09-01T00:16:57,236 adding 'lm_eval/tasks/darijammlu/darijammlu_jurisprudence.yaml' 2026-09-01T00:16:57,237 adding 'lm_eval/tasks/darijammlu/darijammlu_law.yaml' 2026-09-01T00:16:57,238 adding 'lm_eval/tasks/darijammlu/darijammlu_logical_fallacies.yaml' 2026-09-01T00:16:57,239 adding 'lm_eval/tasks/darijammlu/darijammlu_management.yaml' 2026-09-01T00:16:57,240 adding 'lm_eval/tasks/darijammlu/darijammlu_management_ar.yaml' 2026-09-01T00:16:57,241 adding 'lm_eval/tasks/darijammlu/darijammlu_marketing.yaml' 2026-09-01T00:16:57,243 adding 'lm_eval/tasks/darijammlu/darijammlu_math.yaml' 2026-09-01T00:16:57,244 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_disputes.yaml' 2026-09-01T00:16:57,245 adding 'lm_eval/tasks/darijammlu/darijammlu_moral_scenarios.yaml' 2026-09-01T00:16:57,246 adding 'lm_eval/tasks/darijammlu/darijammlu_natural_science.yaml' 2026-09-01T00:16:57,247 adding 'lm_eval/tasks/darijammlu/darijammlu_nutrition.yaml' 2026-09-01T00:16:57,248 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy.yaml' 2026-09-01T00:16:57,250 adding 'lm_eval/tasks/darijammlu/darijammlu_philosophy_ar.yaml' 2026-09-01T00:16:57,251 adding 'lm_eval/tasks/darijammlu/darijammlu_physics.yaml' 2026-09-01T00:16:57,252 adding 'lm_eval/tasks/darijammlu/darijammlu_political_science.yaml' 2026-09-01T00:16:57,253 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml' 2026-09-01T00:16:57,254 adding 'lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml' 2026-09-01T00:16:57,255 adding 'lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml' 2026-09-01T00:16:57,256 adding 'lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml' 2026-09-01T00:16:57,257 adding 'lm_eval/tasks/darijammlu/darijammlu_social_science.yaml' 2026-09-01T00:16:57,258 adding 'lm_eval/tasks/darijammlu/darijammlu_sociology.yaml' 2026-09-01T00:16:57,259 adding 'lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml' 2026-09-01T00:16:57,260 adding 'lm_eval/tasks/darijammlu/utils.py' 2026-09-01T00:16:57,262 adding 'lm_eval/tasks/discrim_eval/README.md' 2026-09-01T00:16:57,263 adding 'lm_eval/tasks/discrim_eval/discrim_eval_explicit.yaml' 2026-09-01T00:16:57,264 adding 'lm_eval/tasks/discrim_eval/discrim_eval_implicit.yaml' 2026-09-01T00:16:57,266 adding 'lm_eval/tasks/discrim_eval/utils.py' 2026-09-01T00:16:57,268 adding 'lm_eval/tasks/drop/README.md' 2026-09-01T00:16:57,269 adding 'lm_eval/tasks/drop/default.yaml' 2026-09-01T00:16:57,271 adding 'lm_eval/tasks/drop/utils.py' 2026-09-01T00:16:57,273 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/README.md' 2026-09-01T00:16:57,274 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/custom_metrics.py' 2026-09-01T00:16:57,275 adding 'lm_eval/tasks/e2lmc/mmlu_early_training/mmlu_early_training.yaml' 2026-09-01T00:16:57,277 adding 'lm_eval/tasks/e2lmc/noor/README.md' 2026-09-01T00:16:57,278 adding 'lm_eval/tasks/e2lmc/noor/_generate_configs.py' 2026-09-01T00:16:57,279 adding 'lm_eval/tasks/e2lmc/noor/_noor.yaml' 2026-09-01T00:16:57,281 adding 'lm_eval/tasks/e2lmc/noor/_noor_stem.yaml' 2026-09-01T00:16:57,282 adding 'lm_eval/tasks/e2lmc/noor/_noor_template' 2026-09-01T00:16:57,283 adding 'lm_eval/tasks/e2lmc/noor/noor_abstract_algebra.yaml' 2026-09-01T00:16:57,284 adding 'lm_eval/tasks/e2lmc/noor/noor_college_computer_science.yaml' 2026-09-01T00:16:57,285 adding 'lm_eval/tasks/e2lmc/noor/noor_college_mathematics.yaml' 2026-09-01T00:16:57,286 adding 'lm_eval/tasks/e2lmc/noor/noor_college_physics.yaml' 2026-09-01T00:16:57,288 adding 'lm_eval/tasks/e2lmc/noor/noor_conceptual_physics.yaml' 2026-09-01T00:16:57,289 adding 'lm_eval/tasks/e2lmc/noor/noor_electrical_engineering.yaml' 2026-09-01T00:16:57,290 adding 'lm_eval/tasks/e2lmc/noor/noor_elementary_mathematics.yaml' 2026-09-01T00:16:57,291 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_computer_science.yaml' 2026-09-01T00:16:57,292 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_mathematics.yaml' 2026-09-01T00:16:57,293 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_physics.yaml' 2026-09-01T00:16:57,294 adding 'lm_eval/tasks/e2lmc/noor/noor_high_school_statistics.yaml' 2026-09-01T00:16:57,296 adding 'lm_eval/tasks/e2lmc/noor/noor_machine_learning.yaml' 2026-09-01T00:16:57,298 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/README.md' 2026-09-01T00:16:57,299 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/_sciknoweval_mcqa.yaml' 2026-09-01T00:16:57,300 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/_var5shots_template_yaml' 2026-09-01T00:16:57,301 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Biology.yaml' 2026-09-01T00:16:57,302 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Chemistry.yaml' 2026-09-01T00:16:57,303 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Material.yaml' 2026-09-01T00:16:57,305 adding 'lm_eval/tasks/e2lmc/sciknoweval_mcqa/sciknoweval_Physics.yaml' 2026-09-01T00:16:57,306 adding 'lm_eval/tasks/egyhellaswag/README.md' 2026-09-01T00:16:57,308 adding 'lm_eval/tasks/egyhellaswag/egyhellaswag.yaml' 2026-09-01T00:16:57,309 adding 'lm_eval/tasks/egyhellaswag/utils.py' 2026-09-01T00:16:57,311 adding 'lm_eval/tasks/egymmlu/README.md' 2026-09-01T00:16:57,313 adding 'lm_eval/tasks/egymmlu/_default_egymmlu_template_yaml' 2026-09-01T00:16:57,314 adding 'lm_eval/tasks/egymmlu/_egymmlu.yaml' 2026-09-01T00:16:57,315 adding 'lm_eval/tasks/egymmlu/_egymmlu_ar_mmlu.yaml' 2026-09-01T00:16:57,316 adding 'lm_eval/tasks/egymmlu/_egymmlu_mmlu.yaml' 2026-09-01T00:16:57,317 adding 'lm_eval/tasks/egymmlu/_generate_configs.py' 2026-09-01T00:16:57,318 adding 'lm_eval/tasks/egymmlu/egymmlu_accounting.yaml' 2026-09-01T00:16:57,319 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language.yaml' 2026-09-01T00:16:57,320 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(general).yaml' 2026-09-01T00:16:57,321 adding 'lm_eval/tasks/egymmlu/egymmlu_arabic_language_(grammar).yaml' 2026-09-01T00:16:57,322 adding 'lm_eval/tasks/egymmlu/egymmlu_biology.yaml' 2026-09-01T00:16:57,323 adding 'lm_eval/tasks/egymmlu/egymmlu_civics.yaml' 2026-09-01T00:16:57,324 adding 'lm_eval/tasks/egymmlu/egymmlu_computer_science.yaml' 2026-09-01T00:16:57,326 adding 'lm_eval/tasks/egymmlu/egymmlu_driving_test.yaml' 2026-09-01T00:16:57,327 adding 'lm_eval/tasks/egymmlu/egymmlu_economics.yaml' 2026-09-01T00:16:57,328 adding 'lm_eval/tasks/egymmlu/egymmlu_general_knowledge.yaml' 2026-09-01T00:16:57,329 adding 'lm_eval/tasks/egymmlu/egymmlu_geography.yaml' 2026-09-01T00:16:57,330 adding 'lm_eval/tasks/egymmlu/egymmlu_global_facts.yaml' 2026-09-01T00:16:57,331 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_european_history.yaml' 2026-09-01T00:16:57,332 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_geography.yaml' 2026-09-01T00:16:57,333 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_government_and_politics.yaml' 2026-09-01T00:16:57,334 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_psychology.yaml' 2026-09-01T00:16:57,335 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_statistics.yaml' 2026-09-01T00:16:57,336 adding 'lm_eval/tasks/egymmlu/egymmlu_high_school_world_history.yaml' 2026-09-01T00:16:57,338 adding 'lm_eval/tasks/egymmlu/egymmlu_history.yaml' 2026-09-01T00:16:57,339 adding 'lm_eval/tasks/egymmlu/egymmlu_human_aging.yaml' 2026-09-01T00:16:57,340 adding 'lm_eval/tasks/egymmlu/egymmlu_international_law.yaml' 2026-09-01T00:16:57,341 adding 'lm_eval/tasks/egymmlu/egymmlu_islamic_studies.yaml' 2026-09-01T00:16:57,342 adding 'lm_eval/tasks/egymmlu/egymmlu_jurisprudence.yaml' 2026-09-01T00:16:57,343 adding 'lm_eval/tasks/egymmlu/egymmlu_law.yaml' 2026-09-01T00:16:57,344 adding 'lm_eval/tasks/egymmlu/egymmlu_logical_fallacies.yaml' 2026-09-01T00:16:57,346 adding 'lm_eval/tasks/egymmlu/egymmlu_management.yaml' 2026-09-01T00:16:57,347 adding 'lm_eval/tasks/egymmlu/egymmlu_management_ar.yaml' 2026-09-01T00:16:57,348 adding 'lm_eval/tasks/egymmlu/egymmlu_marketing.yaml' 2026-09-01T00:16:57,349 adding 'lm_eval/tasks/egymmlu/egymmlu_math.yaml' 2026-09-01T00:16:57,350 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_disputes.yaml' 2026-09-01T00:16:57,351 adding 'lm_eval/tasks/egymmlu/egymmlu_moral_scenarios.yaml' 2026-09-01T00:16:57,352 adding 'lm_eval/tasks/egymmlu/egymmlu_natural_science.yaml' 2026-09-01T00:16:57,354 adding 'lm_eval/tasks/egymmlu/egymmlu_nutrition.yaml' 2026-09-01T00:16:57,355 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy.yaml' 2026-09-01T00:16:57,356 adding 'lm_eval/tasks/egymmlu/egymmlu_philosophy_ar.yaml' 2026-09-01T00:16:57,357 adding 'lm_eval/tasks/egymmlu/egymmlu_physics.yaml' 2026-09-01T00:16:57,358 adding 'lm_eval/tasks/egymmlu/egymmlu_political_science.yaml' 2026-09-01T00:16:57,360 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_law.yaml' 2026-09-01T00:16:57,361 adding 'lm_eval/tasks/egymmlu/egymmlu_professional_psychology.yaml' 2026-09-01T00:16:57,362 adding 'lm_eval/tasks/egymmlu/egymmlu_public_relations.yaml' 2026-09-01T00:16:57,363 adding 'lm_eval/tasks/egymmlu/egymmlu_security_studies.yaml' 2026-09-01T00:16:57,364 adding 'lm_eval/tasks/egymmlu/egymmlu_social_science.yaml' 2026-09-01T00:16:57,365 adding 'lm_eval/tasks/egymmlu/egymmlu_sociology.yaml' 2026-09-01T00:16:57,367 adding 'lm_eval/tasks/egymmlu/egymmlu_world_religions.yaml' 2026-09-01T00:16:57,368 adding 'lm_eval/tasks/egymmlu/utils.py' 2026-09-01T00:16:57,370 adding 'lm_eval/tasks/eq_bench/README.md' 2026-09-01T00:16:57,371 adding 'lm_eval/tasks/eq_bench/default.yaml' 2026-09-01T00:16:57,372 adding 'lm_eval/tasks/eq_bench/utils.py' 2026-09-01T00:16:57,374 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_ca.yaml' 2026-09-01T00:16:57,375 adding 'lm_eval/tasks/eq_bench/multilingual/eqbench_es.yaml' 2026-09-01T00:16:57,376 adding 'lm_eval/tasks/eq_bench/multilingual/utils.py' 2026-09-01T00:16:57,378 adding 'lm_eval/tasks/esbbq/README.md' 2026-09-01T00:16:57,380 adding 'lm_eval/tasks/esbbq/_esbbq_common_yaml' 2026-09-01T00:16:57,381 adding 'lm_eval/tasks/esbbq/esbbq.yaml' 2026-09-01T00:16:57,382 adding 'lm_eval/tasks/esbbq/esbbq_age.yaml' 2026-09-01T00:16:57,383 adding 'lm_eval/tasks/esbbq/esbbq_disability_status.yaml' 2026-09-01T00:16:57,384 adding 'lm_eval/tasks/esbbq/esbbq_gender.yaml' 2026-09-01T00:16:57,385 adding 'lm_eval/tasks/esbbq/esbbq_lgbtqia.yaml' 2026-09-01T00:16:57,386 adding 'lm_eval/tasks/esbbq/esbbq_nationality.yaml' 2026-09-01T00:16:57,387 adding 'lm_eval/tasks/esbbq/esbbq_physical_appearance.yaml' 2026-09-01T00:16:57,389 adding 'lm_eval/tasks/esbbq/esbbq_race_ethnicity.yaml' 2026-09-01T00:16:57,390 adding 'lm_eval/tasks/esbbq/esbbq_religion.yaml' 2026-09-01T00:16:57,391 adding 'lm_eval/tasks/esbbq/esbbq_ses.yaml' 2026-09-01T00:16:57,392 adding 'lm_eval/tasks/esbbq/esbbq_spanish_region.yaml' 2026-09-01T00:16:57,394 adding 'lm_eval/tasks/esbbq/utils.py' 2026-09-01T00:16:57,397 adding 'lm_eval/tasks/eus_exams/README.md' 2026-09-01T00:16:57,398 adding 'lm_eval/tasks/eus_exams/configs.py' 2026-09-01T00:16:57,399 adding 'lm_eval/tasks/eus_exams/eus_exams' 2026-09-01T00:16:57,400 adding 'lm_eval/tasks/eus_exams/eus_exams_es' 2026-09-01T00:16:57,402 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml' 2026-09-01T00:16:57,403 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml' 2026-09-01T00:16:57,404 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml' 2026-09-01T00:16:57,405 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml' 2026-09-01T00:16:57,406 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml' 2026-09-01T00:16:57,407 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml' 2026-09-01T00:16:57,408 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml' 2026-09-01T00:16:57,409 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml' 2026-09-01T00:16:57,410 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml' 2026-09-01T00:16:57,412 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml' 2026-09-01T00:16:57,413 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml' 2026-09-01T00:16:57,414 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml' 2026-09-01T00:16:57,415 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml' 2026-09-01T00:16:57,416 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml' 2026-09-01T00:16:57,418 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml' 2026-09-01T00:16:57,419 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml' 2026-09-01T00:16:57,420 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml' 2026-09-01T00:16:57,421 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml' 2026-09-01T00:16:57,422 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml' 2026-09-01T00:16:57,423 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml' 2026-09-01T00:16:57,424 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml' 2026-09-01T00:16:57,426 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml' 2026-09-01T00:16:57,427 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml' 2026-09-01T00:16:57,428 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml' 2026-09-01T00:16:57,429 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml' 2026-09-01T00:16:57,430 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml' 2026-09-01T00:16:57,432 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml' 2026-09-01T00:16:57,433 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml' 2026-09-01T00:16:57,434 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml' 2026-09-01T00:16:57,435 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml' 2026-09-01T00:16:57,436 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml' 2026-09-01T00:16:57,437 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml' 2026-09-01T00:16:57,438 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml' 2026-09-01T00:16:57,439 adding 'lm_eval/tasks/eus_exams/eus_exams_eu' 2026-09-01T00:16:57,440 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml' 2026-09-01T00:16:57,441 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml' 2026-09-01T00:16:57,442 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml' 2026-09-01T00:16:57,443 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml' 2026-09-01T00:16:57,444 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml' 2026-09-01T00:16:57,446 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml' 2026-09-01T00:16:57,447 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml' 2026-09-01T00:16:57,448 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml' 2026-09-01T00:16:57,449 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml' 2026-09-01T00:16:57,450 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml' 2026-09-01T00:16:57,451 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml' 2026-09-01T00:16:57,452 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml' 2026-09-01T00:16:57,453 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml' 2026-09-01T00:16:57,454 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml' 2026-09-01T00:16:57,455 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml' 2026-09-01T00:16:57,456 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml' 2026-09-01T00:16:57,457 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml' 2026-09-01T00:16:57,459 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml' 2026-09-01T00:16:57,460 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml' 2026-09-01T00:16:57,461 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml' 2026-09-01T00:16:57,462 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml' 2026-09-01T00:16:57,463 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml' 2026-09-01T00:16:57,464 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml' 2026-09-01T00:16:57,465 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml' 2026-09-01T00:16:57,467 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml' 2026-09-01T00:16:57,468 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml' 2026-09-01T00:16:57,469 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml' 2026-09-01T00:16:57,470 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml' 2026-09-01T00:16:57,471 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml' 2026-09-01T00:16:57,472 adding 'lm_eval/tasks/eus_exams/utils.py' 2026-09-01T00:16:57,474 adding 'lm_eval/tasks/eus_proficiency/README.md' 2026-09-01T00:16:57,475 adding 'lm_eval/tasks/eus_proficiency/eus_proficiency.yaml' 2026-09-01T00:16:57,477 adding 'lm_eval/tasks/eus_reading/README.md' 2026-09-01T00:16:57,479 adding 'lm_eval/tasks/eus_reading/eus_reading.yaml' 2026-09-01T00:16:57,480 adding 'lm_eval/tasks/eus_reading/utils.py' 2026-09-01T00:16:57,482 adding 'lm_eval/tasks/eus_trivia/README.md' 2026-09-01T00:16:57,483 adding 'lm_eval/tasks/eus_trivia/eus_trivia.yaml' 2026-09-01T00:16:57,484 adding 'lm_eval/tasks/eus_trivia/utils.py' 2026-09-01T00:16:57,488 adding 'lm_eval/tasks/evalita_llm/README.md' 2026-09-01T00:16:57,489 adding 'lm_eval/tasks/evalita_llm/_at_template_yaml' 2026-09-01T00:16:57,490 adding 'lm_eval/tasks/evalita_llm/_evalita-mp.yaml' 2026-09-01T00:16:57,491 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p1.yaml' 2026-09-01T00:16:57,492 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p2.yaml' 2026-09-01T00:16:57,493 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p3.yaml' 2026-09-01T00:16:57,494 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p4.yaml' 2026-09-01T00:16:57,496 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p5.yaml' 2026-09-01T00:16:57,497 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_task_p6.yaml' 2026-09-01T00:16:57,498 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_at_tasks.yaml' 2026-09-01T00:16:57,499 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p1.yaml' 2026-09-01T00:16:57,500 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p2.yaml' 2026-09-01T00:16:57,502 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p3.yaml' 2026-09-01T00:16:57,503 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p4.yaml' 2026-09-01T00:16:57,504 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p5.yaml' 2026-09-01T00:16:57,505 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_p6.yaml' 2026-09-01T00:16:57,506 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_faq_tasks.yaml' 2026-09-01T00:16:57,507 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_gen.yaml' 2026-09-01T00:16:57,508 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p1.yaml' 2026-09-01T00:16:57,509 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p2.yaml' 2026-09-01T00:16:57,511 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p3.yaml' 2026-09-01T00:16:57,512 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p4.yaml' 2026-09-01T00:16:57,513 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p5.yaml' 2026-09-01T00:16:57,514 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_p6.yaml' 2026-09-01T00:16:57,515 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_hs_task.yaml' 2026-09-01T00:16:57,517 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p1.yaml' 2026-09-01T00:16:57,518 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_p2.yaml' 2026-09-01T00:16:57,519 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ls_task.yaml' 2026-09-01T00:16:57,520 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_mc.yaml' 2026-09-01T00:16:57,521 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group.yaml' 2026-09-01T00:16:57,523 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p1.yaml' 2026-09-01T00:16:57,524 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-adg_group_p2.yaml' 2026-09-01T00:16:57,525 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group.yaml' 2026-09-01T00:16:57,526 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p1.yaml' 2026-09-01T00:16:57,528 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-fic_group_p2.yaml' 2026-09-01T00:16:57,529 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group.yaml' 2026-09-01T00:16:57,530 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p1.yaml' 2026-09-01T00:16:57,531 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner-wn_group_p2.yaml' 2026-09-01T00:16:57,532 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg' 2026-09-01T00:16:57,534 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p1.yaml' 2026-09-01T00:16:57,535 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_adg_p2.yaml' 2026-09-01T00:16:57,536 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic' 2026-09-01T00:16:57,537 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p1.yaml' 2026-09-01T00:16:57,538 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_fic_p2.yaml' 2026-09-01T00:16:57,540 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_group.yaml' 2026-09-01T00:16:57,541 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn' 2026-09-01T00:16:57,542 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p1.yaml' 2026-09-01T00:16:57,543 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_ner_wn_p2.yaml' 2026-09-01T00:16:57,544 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p1.yaml' 2026-09-01T00:16:57,546 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_p2.yaml' 2026-09-01T00:16:57,547 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_re_task.yaml' 2026-09-01T00:16:57,548 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p1.yaml' 2026-09-01T00:16:57,549 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p2.yaml' 2026-09-01T00:16:57,550 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p3.yaml' 2026-09-01T00:16:57,551 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p4.yaml' 2026-09-01T00:16:57,553 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p5.yaml' 2026-09-01T00:16:57,554 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_p6.yaml' 2026-09-01T00:16:57,555 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sa_tasks.yaml' 2026-09-01T00:16:57,556 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p1.yaml' 2026-09-01T00:16:57,557 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_p2.yaml' 2026-09-01T00:16:57,558 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp-small_task.yaml' 2026-09-01T00:16:57,560 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p1.yaml' 2026-09-01T00:16:57,561 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_p2.yaml' 2026-09-01T00:16:57,562 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_sum_fp_task.yaml' 2026-09-01T00:16:57,563 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p1.yaml' 2026-09-01T00:16:57,564 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p2.yaml' 2026-09-01T00:16:57,565 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p3.yaml' 2026-09-01T00:16:57,566 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p4.yaml' 2026-09-01T00:16:57,567 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p5.yaml' 2026-09-01T00:16:57,569 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_p6.yaml' 2026-09-01T00:16:57,570 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_te_tasks.yaml' 2026-09-01T00:16:57,571 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p1.yaml' 2026-09-01T00:16:57,572 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p2.yaml' 2026-09-01T00:16:57,573 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p3.yaml' 2026-09-01T00:16:57,574 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p4.yaml' 2026-09-01T00:16:57,579 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p5.yaml' 2026-09-01T00:16:57,580 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_p6.yaml' 2026-09-01T00:16:57,582 adding 'lm_eval/tasks/evalita_llm/_evalita-mp_wic_tasks.yaml' 2026-09-01T00:16:57,583 adding 'lm_eval/tasks/evalita_llm/_faq_template_yaml' 2026-09-01T00:16:57,584 adding 'lm_eval/tasks/evalita_llm/_hs_template_yaml' 2026-09-01T00:16:57,585 adding 'lm_eval/tasks/evalita_llm/_ls_template_yaml' 2026-09-01T00:16:57,586 adding 'lm_eval/tasks/evalita_llm/_ner_template_yaml' 2026-09-01T00:16:57,588 adding 'lm_eval/tasks/evalita_llm/_re_template_yaml' 2026-09-01T00:16:57,589 adding 'lm_eval/tasks/evalita_llm/_sa_template_v2_yaml' 2026-09-01T00:16:57,590 adding 'lm_eval/tasks/evalita_llm/_sa_template_yaml' 2026-09-01T00:16:57,591 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp-small_yaml' 2026-09-01T00:16:57,593 adding 'lm_eval/tasks/evalita_llm/_sum_template_fp_yaml' 2026-09-01T00:16:57,594 adding 'lm_eval/tasks/evalita_llm/_sum_template_yaml' 2026-09-01T00:16:57,596 adding 'lm_eval/tasks/evalita_llm/_te_template_yaml' 2026-09-01T00:16:57,597 adding 'lm_eval/tasks/evalita_llm/_wic_template_yaml' 2026-09-01T00:16:57,598 adding 'lm_eval/tasks/evalita_llm/metrics.py' 2026-09-01T00:16:57,600 adding 'lm_eval/tasks/evalita_llm/sum_utils.py' 2026-09-01T00:16:57,602 adding 'lm_eval/tasks/evalita_llm/utils.py' 2026-09-01T00:16:57,604 adding 'lm_eval/tasks/fda/README.md' 2026-09-01T00:16:57,605 adding 'lm_eval/tasks/fda/fda.yaml' 2026-09-01T00:16:57,606 adding 'lm_eval/tasks/fda/task.py' 2026-09-01T00:16:57,608 adding 'lm_eval/tasks/fld/README.md' 2026-09-01T00:16:57,610 adding 'lm_eval/tasks/fld/fld_default.yaml' 2026-09-01T00:16:57,611 adding 'lm_eval/tasks/fld/fld_logical_formula_default.yaml' 2026-09-01T00:16:57,612 adding 'lm_eval/tasks/fld/fld_logical_formula_star.yaml' 2026-09-01T00:16:57,613 adding 'lm_eval/tasks/fld/fld_star.yaml' 2026-09-01T00:16:57,615 adding 'lm_eval/tasks/french_bench/README.md' 2026-09-01T00:16:57,616 adding 'lm_eval/tasks/french_bench/_default_template_yaml' 2026-09-01T00:16:57,617 adding 'lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml' 2026-09-01T00:16:57,619 adding 'lm_eval/tasks/french_bench/french_bench_boolqa.yaml' 2026-09-01T00:16:57,620 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2.yaml' 2026-09-01T00:16:57,621 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml' 2026-09-01T00:16:57,622 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml' 2026-09-01T00:16:57,623 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml' 2026-09-01T00:16:57,625 adding 'lm_eval/tasks/french_bench/french_bench_grammar.yaml' 2026-09-01T00:16:57,626 adding 'lm_eval/tasks/french_bench/french_bench_hellaswag.yaml' 2026-09-01T00:16:57,627 adding 'lm_eval/tasks/french_bench/french_bench_multifquad.yaml' 2026-09-01T00:16:57,628 adding 'lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml' 2026-09-01T00:16:57,629 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml' 2026-09-01T00:16:57,630 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml' 2026-09-01T00:16:57,632 adding 'lm_eval/tasks/french_bench/french_bench_reading_comp.yaml' 2026-09-01T00:16:57,633 adding 'lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml' 2026-09-01T00:16:57,634 adding 'lm_eval/tasks/french_bench/french_bench_trivia.yaml' 2026-09-01T00:16:57,635 adding 'lm_eval/tasks/french_bench/french_bench_vocab.yaml' 2026-09-01T00:16:57,636 adding 'lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml' 2026-09-01T00:16:57,638 adding 'lm_eval/tasks/french_bench/french_bench_xnli.yaml' 2026-09-01T00:16:57,639 adding 'lm_eval/tasks/french_bench/preprocess_wikitext.py' 2026-09-01T00:16:57,640 adding 'lm_eval/tasks/french_bench/utils.py' 2026-09-01T00:16:57,642 adding 'lm_eval/tasks/galician_bench/README.md' 2026-09-01T00:16:57,643 adding 'lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml' 2026-09-01T00:16:57,645 adding 'lm_eval/tasks/galician_bench/galcola.yaml' 2026-09-01T00:16:57,646 adding 'lm_eval/tasks/galician_bench/galician_bench.yaml' 2026-09-01T00:16:57,647 adding 'lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml' 2026-09-01T00:16:57,648 adding 'lm_eval/tasks/galician_bench/openbookqa_gl.yaml' 2026-09-01T00:16:57,649 adding 'lm_eval/tasks/galician_bench/parafrases_gl.yaml' 2026-09-01T00:16:57,651 adding 'lm_eval/tasks/galician_bench/paws_gl.yaml' 2026-09-01T00:16:57,652 adding 'lm_eval/tasks/galician_bench/summarization_gl.yaml' 2026-09-01T00:16:57,653 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml' 2026-09-01T00:16:57,654 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml' 2026-09-01T00:16:57,655 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml' 2026-09-01T00:16:57,657 adding 'lm_eval/tasks/galician_bench/utils.py' 2026-09-01T00:16:57,658 adding 'lm_eval/tasks/galician_bench/xnli_gl.yaml' 2026-09-01T00:16:57,660 adding 'lm_eval/tasks/galician_bench/xstorycloze_gl.yaml' 2026-09-01T00:16:57,662 adding 'lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml' 2026-09-01T00:16:57,663 adding 'lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py' 2026-09-01T00:16:57,664 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml' 2026-09-01T00:16:57,666 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml' 2026-09-01T00:16:57,667 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml' 2026-09-01T00:16:57,668 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml' 2026-09-01T00:16:57,669 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml' 2026-09-01T00:16:57,670 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml' 2026-09-01T00:16:57,671 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml' 2026-09-01T00:16:57,672 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml' 2026-09-01T00:16:57,673 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml' 2026-09-01T00:16:57,674 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml' 2026-09-01T00:16:57,675 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml' 2026-09-01T00:16:57,677 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml' 2026-09-01T00:16:57,678 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml' 2026-09-01T00:16:57,679 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml' 2026-09-01T00:16:57,680 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml' 2026-09-01T00:16:57,681 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml' 2026-09-01T00:16:57,682 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml' 2026-09-01T00:16:57,684 adding 'lm_eval/tasks/glianorex/README.md' 2026-09-01T00:16:57,685 adding 'lm_eval/tasks/glianorex/glianorex.yaml' 2026-09-01T00:16:57,686 adding 'lm_eval/tasks/glianorex/glianorex_en.yaml' 2026-09-01T00:16:57,687 adding 'lm_eval/tasks/glianorex/glianorex_fr.yaml' 2026-09-01T00:16:57,688 adding 'lm_eval/tasks/glianorex/preprocess_glianorex.py' 2026-09-01T00:16:57,690 adding 'lm_eval/tasks/global_mmlu/README.md' 2026-09-01T00:16:57,693 adding 'lm_eval/tasks/global_mmlu/default/ar/_ar_template_yaml' 2026-09-01T00:16:57,694 adding 'lm_eval/tasks/global_mmlu/default/ar/_global_mmlu_ar.yaml' 2026-09-01T00:16:57,695 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_business.yaml' 2026-09-01T00:16:57,696 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_humanities.yaml' 2026-09-01T00:16:57,697 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_medical.yaml' 2026-09-01T00:16:57,698 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_other.yaml' 2026-09-01T00:16:57,699 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_social_sciences.yaml' 2026-09-01T00:16:57,701 adding 'lm_eval/tasks/global_mmlu/default/ar/global_mmlu_ar_stem.yaml' 2026-09-01T00:16:57,702 adding 'lm_eval/tasks/global_mmlu/default/ar/utils.py' 2026-09-01T00:16:57,703 adding 'lm_eval/tasks/global_mmlu/default/bn/_bn_template_yaml' 2026-09-01T00:16:57,705 adding 'lm_eval/tasks/global_mmlu/default/bn/_global_mmlu_bn.yaml' 2026-09-01T00:16:57,706 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_business.yaml' 2026-09-01T00:16:57,707 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_humanities.yaml' 2026-09-01T00:16:57,708 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_medical.yaml' 2026-09-01T00:16:57,709 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_other.yaml' 2026-09-01T00:16:57,711 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_social_sciences.yaml' 2026-09-01T00:16:57,712 adding 'lm_eval/tasks/global_mmlu/default/bn/global_mmlu_bn_stem.yaml' 2026-09-01T00:16:57,713 adding 'lm_eval/tasks/global_mmlu/default/bn/utils.py' 2026-09-01T00:16:57,715 adding 'lm_eval/tasks/global_mmlu/default/de/_de_template_yaml' 2026-09-01T00:16:57,716 adding 'lm_eval/tasks/global_mmlu/default/de/_global_mmlu_de.yaml' 2026-09-01T00:16:57,717 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_business.yaml' 2026-09-01T00:16:57,719 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_humanities.yaml' 2026-09-01T00:16:57,720 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_medical.yaml' 2026-09-01T00:16:57,721 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_other.yaml' 2026-09-01T00:16:57,722 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_social_sciences.yaml' 2026-09-01T00:16:57,724 adding 'lm_eval/tasks/global_mmlu/default/de/global_mmlu_de_stem.yaml' 2026-09-01T00:16:57,725 adding 'lm_eval/tasks/global_mmlu/default/de/utils.py' 2026-09-01T00:16:57,727 adding 'lm_eval/tasks/global_mmlu/default/en/_en_template_yaml' 2026-09-01T00:16:57,728 adding 'lm_eval/tasks/global_mmlu/default/en/_global_mmlu_en.yaml' 2026-09-01T00:16:57,729 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_business.yaml' 2026-09-01T00:16:57,730 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_humanities.yaml' 2026-09-01T00:16:57,731 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_medical.yaml' 2026-09-01T00:16:57,732 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_other.yaml' 2026-09-01T00:16:57,733 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_social_sciences.yaml' 2026-09-01T00:16:57,734 adding 'lm_eval/tasks/global_mmlu/default/en/global_mmlu_en_stem.yaml' 2026-09-01T00:16:57,735 adding 'lm_eval/tasks/global_mmlu/default/en/utils.py' 2026-09-01T00:16:57,737 adding 'lm_eval/tasks/global_mmlu/default/es/_es_template_yaml' 2026-09-01T00:16:57,738 adding 'lm_eval/tasks/global_mmlu/default/es/_global_mmlu_es.yaml' 2026-09-01T00:16:57,739 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_business.yaml' 2026-09-01T00:16:57,741 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_humanities.yaml' 2026-09-01T00:16:57,742 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_medical.yaml' 2026-09-01T00:16:57,743 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_other.yaml' 2026-09-01T00:16:57,744 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_social_sciences.yaml' 2026-09-01T00:16:57,745 adding 'lm_eval/tasks/global_mmlu/default/es/global_mmlu_es_stem.yaml' 2026-09-01T00:16:57,746 adding 'lm_eval/tasks/global_mmlu/default/es/utils.py' 2026-09-01T00:16:57,748 adding 'lm_eval/tasks/global_mmlu/default/fr/_fr_template_yaml' 2026-09-01T00:16:57,749 adding 'lm_eval/tasks/global_mmlu/default/fr/_global_mmlu_fr.yaml' 2026-09-01T00:16:57,751 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_business.yaml' 2026-09-01T00:16:57,752 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_humanities.yaml' 2026-09-01T00:16:57,753 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_medical.yaml' 2026-09-01T00:16:57,754 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_other.yaml' 2026-09-01T00:16:57,755 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_social_sciences.yaml' 2026-09-01T00:16:57,756 adding 'lm_eval/tasks/global_mmlu/default/fr/global_mmlu_fr_stem.yaml' 2026-09-01T00:16:57,758 adding 'lm_eval/tasks/global_mmlu/default/fr/utils.py' 2026-09-01T00:16:57,760 adding 'lm_eval/tasks/global_mmlu/default/hi/_global_mmlu_hi.yaml' 2026-09-01T00:16:57,761 adding 'lm_eval/tasks/global_mmlu/default/hi/_hi_template_yaml' 2026-09-01T00:16:57,762 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_business.yaml' 2026-09-01T00:16:57,763 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_humanities.yaml' 2026-09-01T00:16:57,764 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_medical.yaml' 2026-09-01T00:16:57,766 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_other.yaml' 2026-09-01T00:16:57,767 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_social_sciences.yaml' 2026-09-01T00:16:57,768 adding 'lm_eval/tasks/global_mmlu/default/hi/global_mmlu_hi_stem.yaml' 2026-09-01T00:16:57,769 adding 'lm_eval/tasks/global_mmlu/default/hi/utils.py' 2026-09-01T00:16:57,771 adding 'lm_eval/tasks/global_mmlu/default/id/_global_mmlu_id.yaml' 2026-09-01T00:16:57,772 adding 'lm_eval/tasks/global_mmlu/default/id/_id_template_yaml' 2026-09-01T00:16:57,773 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_business.yaml' 2026-09-01T00:16:57,774 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_humanities.yaml' 2026-09-01T00:16:57,776 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_medical.yaml' 2026-09-01T00:16:57,777 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_other.yaml' 2026-09-01T00:16:57,778 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_social_sciences.yaml' 2026-09-01T00:16:57,779 adding 'lm_eval/tasks/global_mmlu/default/id/global_mmlu_id_stem.yaml' 2026-09-01T00:16:57,780 adding 'lm_eval/tasks/global_mmlu/default/id/utils.py' 2026-09-01T00:16:57,782 adding 'lm_eval/tasks/global_mmlu/default/it/_global_mmlu_it.yaml' 2026-09-01T00:16:57,783 adding 'lm_eval/tasks/global_mmlu/default/it/_it_template_yaml' 2026-09-01T00:16:57,784 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_business.yaml' 2026-09-01T00:16:57,785 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_humanities.yaml' 2026-09-01T00:16:57,786 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_medical.yaml' 2026-09-01T00:16:57,787 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_other.yaml' 2026-09-01T00:16:57,789 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_social_sciences.yaml' 2026-09-01T00:16:57,790 adding 'lm_eval/tasks/global_mmlu/default/it/global_mmlu_it_stem.yaml' 2026-09-01T00:16:57,791 adding 'lm_eval/tasks/global_mmlu/default/it/utils.py' 2026-09-01T00:16:57,793 adding 'lm_eval/tasks/global_mmlu/default/ja/_global_mmlu_ja.yaml' 2026-09-01T00:16:57,794 adding 'lm_eval/tasks/global_mmlu/default/ja/_ja_template_yaml' 2026-09-01T00:16:57,795 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_business.yaml' 2026-09-01T00:16:57,796 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_humanities.yaml' 2026-09-01T00:16:57,797 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_medical.yaml' 2026-09-01T00:16:57,798 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_other.yaml' 2026-09-01T00:16:57,799 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_social_sciences.yaml' 2026-09-01T00:16:57,800 adding 'lm_eval/tasks/global_mmlu/default/ja/global_mmlu_ja_stem.yaml' 2026-09-01T00:16:57,802 adding 'lm_eval/tasks/global_mmlu/default/ja/utils.py' 2026-09-01T00:16:57,803 adding 'lm_eval/tasks/global_mmlu/default/ko/_global_mmlu_ko.yaml' 2026-09-01T00:16:57,804 adding 'lm_eval/tasks/global_mmlu/default/ko/_ko_template_yaml' 2026-09-01T00:16:57,806 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_business.yaml' 2026-09-01T00:16:57,807 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_humanities.yaml' 2026-09-01T00:16:57,808 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_medical.yaml' 2026-09-01T00:16:57,809 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_other.yaml' 2026-09-01T00:16:57,810 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_social_sciences.yaml' 2026-09-01T00:16:57,811 adding 'lm_eval/tasks/global_mmlu/default/ko/global_mmlu_ko_stem.yaml' 2026-09-01T00:16:57,812 adding 'lm_eval/tasks/global_mmlu/default/ko/utils.py' 2026-09-01T00:16:57,814 adding 'lm_eval/tasks/global_mmlu/default/pt/_global_mmlu_pt.yaml' 2026-09-01T00:16:57,816 adding 'lm_eval/tasks/global_mmlu/default/pt/_pt_template_yaml' 2026-09-01T00:16:57,817 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_business.yaml' 2026-09-01T00:16:57,818 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_humanities.yaml' 2026-09-01T00:16:57,819 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_medical.yaml' 2026-09-01T00:16:57,820 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_other.yaml' 2026-09-01T00:16:57,821 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_social_sciences.yaml' 2026-09-01T00:16:57,823 adding 'lm_eval/tasks/global_mmlu/default/pt/global_mmlu_pt_stem.yaml' 2026-09-01T00:16:57,824 adding 'lm_eval/tasks/global_mmlu/default/pt/utils.py' 2026-09-01T00:16:57,826 adding 'lm_eval/tasks/global_mmlu/default/sw/_global_mmlu_sw.yaml' 2026-09-01T00:16:57,827 adding 'lm_eval/tasks/global_mmlu/default/sw/_sw_template_yaml' 2026-09-01T00:16:57,828 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_business.yaml' 2026-09-01T00:16:57,829 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_humanities.yaml' 2026-09-01T00:16:57,830 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_medical.yaml' 2026-09-01T00:16:57,831 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_other.yaml' 2026-09-01T00:16:57,832 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_social_sciences.yaml' 2026-09-01T00:16:57,833 adding 'lm_eval/tasks/global_mmlu/default/sw/global_mmlu_sw_stem.yaml' 2026-09-01T00:16:57,834 adding 'lm_eval/tasks/global_mmlu/default/sw/utils.py' 2026-09-01T00:16:57,836 adding 'lm_eval/tasks/global_mmlu/default/yo/_global_mmlu_yo.yaml' 2026-09-01T00:16:57,837 adding 'lm_eval/tasks/global_mmlu/default/yo/_yo_template_yaml' 2026-09-01T00:16:57,838 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_business.yaml' 2026-09-01T00:16:57,840 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_humanities.yaml' 2026-09-01T00:16:57,841 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_medical.yaml' 2026-09-01T00:16:57,842 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_other.yaml' 2026-09-01T00:16:57,843 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_social_sciences.yaml' 2026-09-01T00:16:57,844 adding 'lm_eval/tasks/global_mmlu/default/yo/global_mmlu_yo_stem.yaml' 2026-09-01T00:16:57,845 adding 'lm_eval/tasks/global_mmlu/default/yo/utils.py' 2026-09-01T00:16:57,847 adding 'lm_eval/tasks/global_mmlu/default/zh/_global_mmlu_zh.yaml' 2026-09-01T00:16:57,848 adding 'lm_eval/tasks/global_mmlu/default/zh/_zh_template_yaml' 2026-09-01T00:16:57,850 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_business.yaml' 2026-09-01T00:16:57,851 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_humanities.yaml' 2026-09-01T00:16:57,852 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_medical.yaml' 2026-09-01T00:16:57,853 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_other.yaml' 2026-09-01T00:16:57,854 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_social_sciences.yaml' 2026-09-01T00:16:57,855 adding 'lm_eval/tasks/global_mmlu/default/zh/global_mmlu_zh_stem.yaml' 2026-09-01T00:16:57,857 adding 'lm_eval/tasks/global_mmlu/default/zh/utils.py' 2026-09-01T00:16:57,861 adding 'lm_eval/tasks/global_mmlu/full/am/_am_template_yaml' 2026-09-01T00:16:57,862 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am.yaml' 2026-09-01T00:16:57,863 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml' 2026-09-01T00:16:57,864 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml' 2026-09-01T00:16:57,865 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml' 2026-09-01T00:16:57,866 adding 'lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml' 2026-09-01T00:16:57,868 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml' 2026-09-01T00:16:57,869 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml' 2026-09-01T00:16:57,870 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml' 2026-09-01T00:16:57,871 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml' 2026-09-01T00:16:57,872 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml' 2026-09-01T00:16:57,874 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml' 2026-09-01T00:16:57,875 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml' 2026-09-01T00:16:57,876 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml' 2026-09-01T00:16:57,877 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml' 2026-09-01T00:16:57,878 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml' 2026-09-01T00:16:57,880 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml' 2026-09-01T00:16:57,881 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml' 2026-09-01T00:16:57,882 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml' 2026-09-01T00:16:57,883 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml' 2026-09-01T00:16:57,884 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml' 2026-09-01T00:16:57,885 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml' 2026-09-01T00:16:57,886 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml' 2026-09-01T00:16:57,888 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml' 2026-09-01T00:16:57,889 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml' 2026-09-01T00:16:57,890 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml' 2026-09-01T00:16:57,891 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml' 2026-09-01T00:16:57,893 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml' 2026-09-01T00:16:57,894 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml' 2026-09-01T00:16:57,895 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml' 2026-09-01T00:16:57,896 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml' 2026-09-01T00:16:57,897 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml' 2026-09-01T00:16:57,898 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml' 2026-09-01T00:16:57,899 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml' 2026-09-01T00:16:57,900 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml' 2026-09-01T00:16:57,902 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml' 2026-09-01T00:16:57,903 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml' 2026-09-01T00:16:57,904 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml' 2026-09-01T00:16:57,905 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml' 2026-09-01T00:16:57,906 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml' 2026-09-01T00:16:57,907 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml' 2026-09-01T00:16:57,908 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml' 2026-09-01T00:16:57,909 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml' 2026-09-01T00:16:57,911 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml' 2026-09-01T00:16:57,912 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml' 2026-09-01T00:16:57,913 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml' 2026-09-01T00:16:57,914 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml' 2026-09-01T00:16:57,917 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml' 2026-09-01T00:16:57,918 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml' 2026-09-01T00:16:57,919 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml' 2026-09-01T00:16:57,920 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml' 2026-09-01T00:16:57,921 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml' 2026-09-01T00:16:57,923 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml' 2026-09-01T00:16:57,924 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml' 2026-09-01T00:16:57,925 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml' 2026-09-01T00:16:57,926 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml' 2026-09-01T00:16:57,927 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml' 2026-09-01T00:16:57,928 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml' 2026-09-01T00:16:57,929 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml' 2026-09-01T00:16:57,930 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml' 2026-09-01T00:16:57,931 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml' 2026-09-01T00:16:57,932 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml' 2026-09-01T00:16:57,934 adding 'lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_world_religions.yaml' 2026-09-01T00:16:57,935 adding 'lm_eval/tasks/global_mmlu/full/am/utils.py' 2026-09-01T00:16:57,938 adding 'lm_eval/tasks/global_mmlu/full/ar/_ar_template_yaml' 2026-09-01T00:16:57,940 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar.yaml' 2026-09-01T00:16:57,943 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_humanities.yaml' 2026-09-01T00:16:57,944 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_other.yaml' 2026-09-01T00:16:57,946 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_social_sciences.yaml' 2026-09-01T00:16:57,948 adding 'lm_eval/tasks/global_mmlu/full/ar/_global_mmlu_full_ar_stem.yaml' 2026-09-01T00:16:57,950 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_abstract_algebra.yaml' 2026-09-01T00:16:57,951 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_anatomy.yaml' 2026-09-01T00:16:57,953 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_astronomy.yaml' 2026-09-01T00:16:57,955 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_business_ethics.yaml' 2026-09-01T00:16:57,956 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_clinical_knowledge.yaml' 2026-09-01T00:16:57,958 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_biology.yaml' 2026-09-01T00:16:57,960 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_chemistry.yaml' 2026-09-01T00:16:57,961 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_computer_science.yaml' 2026-09-01T00:16:57,963 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_mathematics.yaml' 2026-09-01T00:16:57,965 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_medicine.yaml' 2026-09-01T00:16:57,967 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_college_physics.yaml' 2026-09-01T00:16:57,969 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_computer_security.yaml' 2026-09-01T00:16:57,970 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml' 2026-09-01T00:16:57,972 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml' 2026-09-01T00:16:57,974 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml' 2026-09-01T00:16:57,976 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml' 2026-09-01T00:16:57,978 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml' 2026-09-01T00:16:57,980 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml' 2026-09-01T00:16:57,982 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml' 2026-09-01T00:16:57,983 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml' 2026-09-01T00:16:57,984 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml' 2026-09-01T00:16:57,986 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml' 2026-09-01T00:16:57,987 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml' 2026-09-01T00:16:57,988 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml' 2026-09-01T00:16:57,989 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml' 2026-09-01T00:16:57,990 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml' 2026-09-01T00:16:57,992 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml' 2026-09-01T00:16:57,993 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml' 2026-09-01T00:16:57,994 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml' 2026-09-01T00:16:57,996 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml' 2026-09-01T00:16:57,997 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml' 2026-09-01T00:16:57,999 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml' 2026-09-01T00:16:58,000 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_aging.yaml' 2026-09-01T00:16:58,001 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_human_sexuality.yaml' 2026-09-01T00:16:58,003 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_international_law.yaml' 2026-09-01T00:16:58,004 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_jurisprudence.yaml' 2026-09-01T00:16:58,006 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_logical_fallacies.yaml' 2026-09-01T00:16:58,008 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_machine_learning.yaml' 2026-09-01T00:16:58,009 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_management.yaml' 2026-09-01T00:16:58,011 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_marketing.yaml' 2026-09-01T00:16:58,013 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_medical_genetics.yaml' 2026-09-01T00:16:58,015 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_miscellaneous.yaml' 2026-09-01T00:16:58,017 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_disputes.yaml' 2026-09-01T00:16:58,019 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_moral_scenarios.yaml' 2026-09-01T00:16:58,021 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_nutrition.yaml' 2026-09-01T00:16:58,023 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_philosophy.yaml' 2026-09-01T00:16:58,025 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_prehistory.yaml' 2026-09-01T00:16:58,026 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_accounting.yaml' 2026-09-01T00:16:58,028 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_law.yaml' 2026-09-01T00:16:58,031 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_medicine.yaml' 2026-09-01T00:16:58,032 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_professional_psychology.yaml' 2026-09-01T00:16:58,034 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_public_relations.yaml' 2026-09-01T00:16:58,035 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_security_studies.yaml' 2026-09-01T00:16:58,036 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_sociology.yaml' 2026-09-01T00:16:58,038 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_us_foreign_policy.yaml' 2026-09-01T00:16:58,039 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_virology.yaml' 2026-09-01T00:16:58,041 adding 'lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_world_religions.yaml' 2026-09-01T00:16:58,042 adding 'lm_eval/tasks/global_mmlu/full/ar/utils.py' 2026-09-01T00:16:58,045 adding 'lm_eval/tasks/global_mmlu/full/bn/_bn_template_yaml' 2026-09-01T00:16:58,047 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn.yaml' 2026-09-01T00:16:58,048 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_humanities.yaml' 2026-09-01T00:16:58,050 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_other.yaml' 2026-09-01T00:16:58,051 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_social_sciences.yaml' 2026-09-01T00:16:58,053 adding 'lm_eval/tasks/global_mmlu/full/bn/_global_mmlu_full_bn_stem.yaml' 2026-09-01T00:16:58,054 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_abstract_algebra.yaml' 2026-09-01T00:16:58,056 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_anatomy.yaml' 2026-09-01T00:16:58,057 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_astronomy.yaml' 2026-09-01T00:16:58,058 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_business_ethics.yaml' 2026-09-01T00:16:58,060 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_clinical_knowledge.yaml' 2026-09-01T00:16:58,061 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_biology.yaml' 2026-09-01T00:16:58,063 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_chemistry.yaml' 2026-09-01T00:16:58,064 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_computer_science.yaml' 2026-09-01T00:16:58,066 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_mathematics.yaml' 2026-09-01T00:16:58,067 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_medicine.yaml' 2026-09-01T00:16:58,069 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_college_physics.yaml' 2026-09-01T00:16:58,070 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_computer_security.yaml' 2026-09-01T00:16:58,071 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_conceptual_physics.yaml' 2026-09-01T00:16:58,073 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_econometrics.yaml' 2026-09-01T00:16:58,074 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_electrical_engineering.yaml' 2026-09-01T00:16:58,076 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_elementary_mathematics.yaml' 2026-09-01T00:16:58,077 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_formal_logic.yaml' 2026-09-01T00:16:58,078 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_global_facts.yaml' 2026-09-01T00:16:58,080 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_biology.yaml' 2026-09-01T00:16:58,081 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_chemistry.yaml' 2026-09-01T00:16:58,082 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_computer_science.yaml' 2026-09-01T00:16:58,084 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_european_history.yaml' 2026-09-01T00:16:58,085 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_geography.yaml' 2026-09-01T00:16:58,087 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,088 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,089 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_mathematics.yaml' 2026-09-01T00:16:58,091 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_microeconomics.yaml' 2026-09-01T00:16:58,092 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_physics.yaml' 2026-09-01T00:16:58,094 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_psychology.yaml' 2026-09-01T00:16:58,095 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_statistics.yaml' 2026-09-01T00:16:58,097 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_us_history.yaml' 2026-09-01T00:16:58,098 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_high_school_world_history.yaml' 2026-09-01T00:16:58,099 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_aging.yaml' 2026-09-01T00:16:58,101 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_human_sexuality.yaml' 2026-09-01T00:16:58,102 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_international_law.yaml' 2026-09-01T00:16:58,104 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_jurisprudence.yaml' 2026-09-01T00:16:58,105 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_logical_fallacies.yaml' 2026-09-01T00:16:58,107 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_machine_learning.yaml' 2026-09-01T00:16:58,108 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_management.yaml' 2026-09-01T00:16:58,109 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_marketing.yaml' 2026-09-01T00:16:58,111 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_medical_genetics.yaml' 2026-09-01T00:16:58,112 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_miscellaneous.yaml' 2026-09-01T00:16:58,114 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_disputes.yaml' 2026-09-01T00:16:58,115 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_moral_scenarios.yaml' 2026-09-01T00:16:58,117 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_nutrition.yaml' 2026-09-01T00:16:58,118 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_philosophy.yaml' 2026-09-01T00:16:58,119 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_prehistory.yaml' 2026-09-01T00:16:58,121 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_accounting.yaml' 2026-09-01T00:16:58,122 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_law.yaml' 2026-09-01T00:16:58,124 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_medicine.yaml' 2026-09-01T00:16:58,125 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_professional_psychology.yaml' 2026-09-01T00:16:58,126 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_public_relations.yaml' 2026-09-01T00:16:58,128 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_security_studies.yaml' 2026-09-01T00:16:58,129 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_sociology.yaml' 2026-09-01T00:16:58,131 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_us_foreign_policy.yaml' 2026-09-01T00:16:58,132 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_virology.yaml' 2026-09-01T00:16:58,133 adding 'lm_eval/tasks/global_mmlu/full/bn/global_mmlu_full_bn_world_religions.yaml' 2026-09-01T00:16:58,135 adding 'lm_eval/tasks/global_mmlu/full/bn/utils.py' 2026-09-01T00:16:58,138 adding 'lm_eval/tasks/global_mmlu/full/cs/_cs_template_yaml' 2026-09-01T00:16:58,140 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs.yaml' 2026-09-01T00:16:58,141 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_humanities.yaml' 2026-09-01T00:16:58,143 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_other.yaml' 2026-09-01T00:16:58,144 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_social_sciences.yaml' 2026-09-01T00:16:58,146 adding 'lm_eval/tasks/global_mmlu/full/cs/_global_mmlu_full_cs_stem.yaml' 2026-09-01T00:16:58,147 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_abstract_algebra.yaml' 2026-09-01T00:16:58,148 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_anatomy.yaml' 2026-09-01T00:16:58,150 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_astronomy.yaml' 2026-09-01T00:16:58,151 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_business_ethics.yaml' 2026-09-01T00:16:58,153 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_clinical_knowledge.yaml' 2026-09-01T00:16:58,154 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_biology.yaml' 2026-09-01T00:16:58,156 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_chemistry.yaml' 2026-09-01T00:16:58,157 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_computer_science.yaml' 2026-09-01T00:16:58,159 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_mathematics.yaml' 2026-09-01T00:16:58,160 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_medicine.yaml' 2026-09-01T00:16:58,161 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_college_physics.yaml' 2026-09-01T00:16:58,163 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_computer_security.yaml' 2026-09-01T00:16:58,164 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_conceptual_physics.yaml' 2026-09-01T00:16:58,166 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_econometrics.yaml' 2026-09-01T00:16:58,167 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_electrical_engineering.yaml' 2026-09-01T00:16:58,169 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_elementary_mathematics.yaml' 2026-09-01T00:16:58,170 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_formal_logic.yaml' 2026-09-01T00:16:58,171 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_global_facts.yaml' 2026-09-01T00:16:58,173 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_biology.yaml' 2026-09-01T00:16:58,174 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_chemistry.yaml' 2026-09-01T00:16:58,176 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_computer_science.yaml' 2026-09-01T00:16:58,177 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_european_history.yaml' 2026-09-01T00:16:58,178 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_geography.yaml' 2026-09-01T00:16:58,180 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,181 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,183 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_mathematics.yaml' 2026-09-01T00:16:58,184 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_microeconomics.yaml' 2026-09-01T00:16:58,185 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_physics.yaml' 2026-09-01T00:16:58,187 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_psychology.yaml' 2026-09-01T00:16:58,188 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_statistics.yaml' 2026-09-01T00:16:58,189 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_us_history.yaml' 2026-09-01T00:16:58,191 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_high_school_world_history.yaml' 2026-09-01T00:16:58,192 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_aging.yaml' 2026-09-01T00:16:58,194 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_human_sexuality.yaml' 2026-09-01T00:16:58,195 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_international_law.yaml' 2026-09-01T00:16:58,197 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_jurisprudence.yaml' 2026-09-01T00:16:58,198 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_logical_fallacies.yaml' 2026-09-01T00:16:58,200 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_machine_learning.yaml' 2026-09-01T00:16:58,201 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_management.yaml' 2026-09-01T00:16:58,203 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_marketing.yaml' 2026-09-01T00:16:58,204 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_medical_genetics.yaml' 2026-09-01T00:16:58,206 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_miscellaneous.yaml' 2026-09-01T00:16:58,207 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_disputes.yaml' 2026-09-01T00:16:58,208 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_moral_scenarios.yaml' 2026-09-01T00:16:58,210 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_nutrition.yaml' 2026-09-01T00:16:58,212 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_philosophy.yaml' 2026-09-01T00:16:58,213 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_prehistory.yaml' 2026-09-01T00:16:58,215 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_accounting.yaml' 2026-09-01T00:16:58,216 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_law.yaml' 2026-09-01T00:16:58,218 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_medicine.yaml' 2026-09-01T00:16:58,219 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_professional_psychology.yaml' 2026-09-01T00:16:58,221 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_public_relations.yaml' 2026-09-01T00:16:58,223 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_security_studies.yaml' 2026-09-01T00:16:58,224 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_sociology.yaml' 2026-09-01T00:16:58,226 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_us_foreign_policy.yaml' 2026-09-01T00:16:58,227 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_virology.yaml' 2026-09-01T00:16:58,229 adding 'lm_eval/tasks/global_mmlu/full/cs/global_mmlu_full_cs_world_religions.yaml' 2026-09-01T00:16:58,231 adding 'lm_eval/tasks/global_mmlu/full/cs/utils.py' 2026-09-01T00:16:58,234 adding 'lm_eval/tasks/global_mmlu/full/de/_de_template_yaml' 2026-09-01T00:16:58,236 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de.yaml' 2026-09-01T00:16:58,237 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_humanities.yaml' 2026-09-01T00:16:58,239 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_other.yaml' 2026-09-01T00:16:58,241 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_social_sciences.yaml' 2026-09-01T00:16:58,242 adding 'lm_eval/tasks/global_mmlu/full/de/_global_mmlu_full_de_stem.yaml' 2026-09-01T00:16:58,244 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_abstract_algebra.yaml' 2026-09-01T00:16:58,245 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_anatomy.yaml' 2026-09-01T00:16:58,247 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_astronomy.yaml' 2026-09-01T00:16:58,249 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_business_ethics.yaml' 2026-09-01T00:16:58,250 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_clinical_knowledge.yaml' 2026-09-01T00:16:58,252 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_biology.yaml' 2026-09-01T00:16:58,253 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_chemistry.yaml' 2026-09-01T00:16:58,255 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_computer_science.yaml' 2026-09-01T00:16:58,256 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_mathematics.yaml' 2026-09-01T00:16:58,257 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_medicine.yaml' 2026-09-01T00:16:58,259 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_college_physics.yaml' 2026-09-01T00:16:58,260 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_computer_security.yaml' 2026-09-01T00:16:58,262 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_conceptual_physics.yaml' 2026-09-01T00:16:58,263 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_econometrics.yaml' 2026-09-01T00:16:58,265 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_electrical_engineering.yaml' 2026-09-01T00:16:58,266 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_elementary_mathematics.yaml' 2026-09-01T00:16:58,268 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_formal_logic.yaml' 2026-09-01T00:16:58,269 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_global_facts.yaml' 2026-09-01T00:16:58,270 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_biology.yaml' 2026-09-01T00:16:58,272 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_chemistry.yaml' 2026-09-01T00:16:58,273 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_computer_science.yaml' 2026-09-01T00:16:58,275 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_european_history.yaml' 2026-09-01T00:16:58,276 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_geography.yaml' 2026-09-01T00:16:58,278 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,279 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,280 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_mathematics.yaml' 2026-09-01T00:16:58,282 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_microeconomics.yaml' 2026-09-01T00:16:58,283 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_physics.yaml' 2026-09-01T00:16:58,285 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_psychology.yaml' 2026-09-01T00:16:58,286 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_statistics.yaml' 2026-09-01T00:16:58,288 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_us_history.yaml' 2026-09-01T00:16:58,289 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_high_school_world_history.yaml' 2026-09-01T00:16:58,290 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_aging.yaml' 2026-09-01T00:16:58,292 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_human_sexuality.yaml' 2026-09-01T00:16:58,293 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_international_law.yaml' 2026-09-01T00:16:58,294 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_jurisprudence.yaml' 2026-09-01T00:16:58,295 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_logical_fallacies.yaml' 2026-09-01T00:16:58,297 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_machine_learning.yaml' 2026-09-01T00:16:58,298 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_management.yaml' 2026-09-01T00:16:58,299 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_marketing.yaml' 2026-09-01T00:16:58,300 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_medical_genetics.yaml' 2026-09-01T00:16:58,301 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_miscellaneous.yaml' 2026-09-01T00:16:58,302 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_disputes.yaml' 2026-09-01T00:16:58,304 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_moral_scenarios.yaml' 2026-09-01T00:16:58,305 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_nutrition.yaml' 2026-09-01T00:16:58,306 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_philosophy.yaml' 2026-09-01T00:16:58,307 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_prehistory.yaml' 2026-09-01T00:16:58,309 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_accounting.yaml' 2026-09-01T00:16:58,310 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_law.yaml' 2026-09-01T00:16:58,311 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_medicine.yaml' 2026-09-01T00:16:58,312 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_professional_psychology.yaml' 2026-09-01T00:16:58,313 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_public_relations.yaml' 2026-09-01T00:16:58,314 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_security_studies.yaml' 2026-09-01T00:16:58,316 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_sociology.yaml' 2026-09-01T00:16:58,317 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_us_foreign_policy.yaml' 2026-09-01T00:16:58,318 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_virology.yaml' 2026-09-01T00:16:58,319 adding 'lm_eval/tasks/global_mmlu/full/de/global_mmlu_full_de_world_religions.yaml' 2026-09-01T00:16:58,320 adding 'lm_eval/tasks/global_mmlu/full/de/utils.py' 2026-09-01T00:16:58,323 adding 'lm_eval/tasks/global_mmlu/full/el/_el_template_yaml' 2026-09-01T00:16:58,325 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el.yaml' 2026-09-01T00:16:58,326 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_humanities.yaml' 2026-09-01T00:16:58,327 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_other.yaml' 2026-09-01T00:16:58,328 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_social_sciences.yaml' 2026-09-01T00:16:58,329 adding 'lm_eval/tasks/global_mmlu/full/el/_global_mmlu_full_el_stem.yaml' 2026-09-01T00:16:58,330 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_abstract_algebra.yaml' 2026-09-01T00:16:58,332 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_anatomy.yaml' 2026-09-01T00:16:58,333 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_astronomy.yaml' 2026-09-01T00:16:58,334 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_business_ethics.yaml' 2026-09-01T00:16:58,335 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_clinical_knowledge.yaml' 2026-09-01T00:16:58,336 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_biology.yaml' 2026-09-01T00:16:58,337 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_chemistry.yaml' 2026-09-01T00:16:58,338 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_computer_science.yaml' 2026-09-01T00:16:58,340 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_mathematics.yaml' 2026-09-01T00:16:58,341 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_medicine.yaml' 2026-09-01T00:16:58,342 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_college_physics.yaml' 2026-09-01T00:16:58,343 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_computer_security.yaml' 2026-09-01T00:16:58,344 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_conceptual_physics.yaml' 2026-09-01T00:16:58,346 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_econometrics.yaml' 2026-09-01T00:16:58,347 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_electrical_engineering.yaml' 2026-09-01T00:16:58,348 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_elementary_mathematics.yaml' 2026-09-01T00:16:58,350 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_formal_logic.yaml' 2026-09-01T00:16:58,351 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_global_facts.yaml' 2026-09-01T00:16:58,352 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_biology.yaml' 2026-09-01T00:16:58,353 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_chemistry.yaml' 2026-09-01T00:16:58,354 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_computer_science.yaml' 2026-09-01T00:16:58,356 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_european_history.yaml' 2026-09-01T00:16:58,357 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_geography.yaml' 2026-09-01T00:16:58,358 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,359 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,360 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_mathematics.yaml' 2026-09-01T00:16:58,361 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_microeconomics.yaml' 2026-09-01T00:16:58,363 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_physics.yaml' 2026-09-01T00:16:58,364 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_psychology.yaml' 2026-09-01T00:16:58,365 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_statistics.yaml' 2026-09-01T00:16:58,366 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_us_history.yaml' 2026-09-01T00:16:58,367 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_high_school_world_history.yaml' 2026-09-01T00:16:58,368 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_aging.yaml' 2026-09-01T00:16:58,369 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_human_sexuality.yaml' 2026-09-01T00:16:58,371 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_international_law.yaml' 2026-09-01T00:16:58,372 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_jurisprudence.yaml' 2026-09-01T00:16:58,373 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_logical_fallacies.yaml' 2026-09-01T00:16:58,374 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_machine_learning.yaml' 2026-09-01T00:16:58,375 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_management.yaml' 2026-09-01T00:16:58,376 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_marketing.yaml' 2026-09-01T00:16:58,377 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_medical_genetics.yaml' 2026-09-01T00:16:58,379 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_miscellaneous.yaml' 2026-09-01T00:16:58,380 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_disputes.yaml' 2026-09-01T00:16:58,381 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_moral_scenarios.yaml' 2026-09-01T00:16:58,382 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_nutrition.yaml' 2026-09-01T00:16:58,383 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_philosophy.yaml' 2026-09-01T00:16:58,384 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_prehistory.yaml' 2026-09-01T00:16:58,386 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_accounting.yaml' 2026-09-01T00:16:58,387 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_law.yaml' 2026-09-01T00:16:58,388 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_medicine.yaml' 2026-09-01T00:16:58,389 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_professional_psychology.yaml' 2026-09-01T00:16:58,390 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_public_relations.yaml' 2026-09-01T00:16:58,392 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_security_studies.yaml' 2026-09-01T00:16:58,393 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_sociology.yaml' 2026-09-01T00:16:58,394 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_us_foreign_policy.yaml' 2026-09-01T00:16:58,395 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_virology.yaml' 2026-09-01T00:16:58,396 adding 'lm_eval/tasks/global_mmlu/full/el/global_mmlu_full_el_world_religions.yaml' 2026-09-01T00:16:58,398 adding 'lm_eval/tasks/global_mmlu/full/el/utils.py' 2026-09-01T00:16:58,401 adding 'lm_eval/tasks/global_mmlu/full/en/_en_template_yaml' 2026-09-01T00:16:58,402 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en.yaml' 2026-09-01T00:16:58,403 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_humanities.yaml' 2026-09-01T00:16:58,404 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_other.yaml' 2026-09-01T00:16:58,405 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_social_sciences.yaml' 2026-09-01T00:16:58,407 adding 'lm_eval/tasks/global_mmlu/full/en/_global_mmlu_full_en_stem.yaml' 2026-09-01T00:16:58,408 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_abstract_algebra.yaml' 2026-09-01T00:16:58,409 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_anatomy.yaml' 2026-09-01T00:16:58,410 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_astronomy.yaml' 2026-09-01T00:16:58,411 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_business_ethics.yaml' 2026-09-01T00:16:58,412 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_clinical_knowledge.yaml' 2026-09-01T00:16:58,413 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_biology.yaml' 2026-09-01T00:16:58,414 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_chemistry.yaml' 2026-09-01T00:16:58,416 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_computer_science.yaml' 2026-09-01T00:16:58,417 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_mathematics.yaml' 2026-09-01T00:16:58,418 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_medicine.yaml' 2026-09-01T00:16:58,419 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_college_physics.yaml' 2026-09-01T00:16:58,420 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_computer_security.yaml' 2026-09-01T00:16:58,421 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_conceptual_physics.yaml' 2026-09-01T00:16:58,422 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_econometrics.yaml' 2026-09-01T00:16:58,423 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_electrical_engineering.yaml' 2026-09-01T00:16:58,425 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_elementary_mathematics.yaml' 2026-09-01T00:16:58,426 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_formal_logic.yaml' 2026-09-01T00:16:58,427 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_global_facts.yaml' 2026-09-01T00:16:58,428 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_biology.yaml' 2026-09-01T00:16:58,429 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_chemistry.yaml' 2026-09-01T00:16:58,430 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_computer_science.yaml' 2026-09-01T00:16:58,432 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_european_history.yaml' 2026-09-01T00:16:58,433 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_geography.yaml' 2026-09-01T00:16:58,434 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,435 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,436 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_mathematics.yaml' 2026-09-01T00:16:58,437 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_microeconomics.yaml' 2026-09-01T00:16:58,439 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_physics.yaml' 2026-09-01T00:16:58,440 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_psychology.yaml' 2026-09-01T00:16:58,441 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_statistics.yaml' 2026-09-01T00:16:58,442 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_us_history.yaml' 2026-09-01T00:16:58,443 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_high_school_world_history.yaml' 2026-09-01T00:16:58,445 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_aging.yaml' 2026-09-01T00:16:58,446 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_human_sexuality.yaml' 2026-09-01T00:16:58,447 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_international_law.yaml' 2026-09-01T00:16:58,448 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_jurisprudence.yaml' 2026-09-01T00:16:58,449 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_logical_fallacies.yaml' 2026-09-01T00:16:58,450 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_machine_learning.yaml' 2026-09-01T00:16:58,451 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_management.yaml' 2026-09-01T00:16:58,453 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_marketing.yaml' 2026-09-01T00:16:58,454 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_medical_genetics.yaml' 2026-09-01T00:16:58,455 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_miscellaneous.yaml' 2026-09-01T00:16:58,456 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_disputes.yaml' 2026-09-01T00:16:58,457 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_moral_scenarios.yaml' 2026-09-01T00:16:58,459 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_nutrition.yaml' 2026-09-01T00:16:58,460 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_philosophy.yaml' 2026-09-01T00:16:58,461 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_prehistory.yaml' 2026-09-01T00:16:58,462 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_accounting.yaml' 2026-09-01T00:16:58,463 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_law.yaml' 2026-09-01T00:16:58,464 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_medicine.yaml' 2026-09-01T00:16:58,465 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_professional_psychology.yaml' 2026-09-01T00:16:58,467 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_public_relations.yaml' 2026-09-01T00:16:58,468 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_security_studies.yaml' 2026-09-01T00:16:58,469 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_sociology.yaml' 2026-09-01T00:16:58,470 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_us_foreign_policy.yaml' 2026-09-01T00:16:58,471 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_virology.yaml' 2026-09-01T00:16:58,473 adding 'lm_eval/tasks/global_mmlu/full/en/global_mmlu_full_en_world_religions.yaml' 2026-09-01T00:16:58,474 adding 'lm_eval/tasks/global_mmlu/full/en/utils.py' 2026-09-01T00:16:58,477 adding 'lm_eval/tasks/global_mmlu/full/es/_es_template_yaml' 2026-09-01T00:16:58,478 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es.yaml' 2026-09-01T00:16:58,479 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_humanities.yaml' 2026-09-01T00:16:58,480 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_other.yaml' 2026-09-01T00:16:58,482 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_social_sciences.yaml' 2026-09-01T00:16:58,483 adding 'lm_eval/tasks/global_mmlu/full/es/_global_mmlu_full_es_stem.yaml' 2026-09-01T00:16:58,484 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_abstract_algebra.yaml' 2026-09-01T00:16:58,485 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_anatomy.yaml' 2026-09-01T00:16:58,486 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_astronomy.yaml' 2026-09-01T00:16:58,488 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_business_ethics.yaml' 2026-09-01T00:16:58,489 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_clinical_knowledge.yaml' 2026-09-01T00:16:58,490 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_biology.yaml' 2026-09-01T00:16:58,491 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_chemistry.yaml' 2026-09-01T00:16:58,493 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_computer_science.yaml' 2026-09-01T00:16:58,494 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_mathematics.yaml' 2026-09-01T00:16:58,495 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_medicine.yaml' 2026-09-01T00:16:58,496 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_college_physics.yaml' 2026-09-01T00:16:58,497 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_computer_security.yaml' 2026-09-01T00:16:58,498 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_conceptual_physics.yaml' 2026-09-01T00:16:58,499 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_econometrics.yaml' 2026-09-01T00:16:58,501 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_electrical_engineering.yaml' 2026-09-01T00:16:58,502 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_elementary_mathematics.yaml' 2026-09-01T00:16:58,503 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_formal_logic.yaml' 2026-09-01T00:16:58,504 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_global_facts.yaml' 2026-09-01T00:16:58,506 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_biology.yaml' 2026-09-01T00:16:58,507 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_chemistry.yaml' 2026-09-01T00:16:58,508 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_computer_science.yaml' 2026-09-01T00:16:58,509 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_european_history.yaml' 2026-09-01T00:16:58,510 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_geography.yaml' 2026-09-01T00:16:58,511 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,512 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,513 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_mathematics.yaml' 2026-09-01T00:16:58,514 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_microeconomics.yaml' 2026-09-01T00:16:58,516 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_physics.yaml' 2026-09-01T00:16:58,517 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_psychology.yaml' 2026-09-01T00:16:58,518 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_statistics.yaml' 2026-09-01T00:16:58,519 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_us_history.yaml' 2026-09-01T00:16:58,520 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_high_school_world_history.yaml' 2026-09-01T00:16:58,522 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_aging.yaml' 2026-09-01T00:16:58,523 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_human_sexuality.yaml' 2026-09-01T00:16:58,524 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_international_law.yaml' 2026-09-01T00:16:58,525 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_jurisprudence.yaml' 2026-09-01T00:16:58,526 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_logical_fallacies.yaml' 2026-09-01T00:16:58,527 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_machine_learning.yaml' 2026-09-01T00:16:58,529 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_management.yaml' 2026-09-01T00:16:58,530 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_marketing.yaml' 2026-09-01T00:16:58,531 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_medical_genetics.yaml' 2026-09-01T00:16:58,532 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_miscellaneous.yaml' 2026-09-01T00:16:58,533 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_disputes.yaml' 2026-09-01T00:16:58,535 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_moral_scenarios.yaml' 2026-09-01T00:16:58,536 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_nutrition.yaml' 2026-09-01T00:16:58,537 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_philosophy.yaml' 2026-09-01T00:16:58,538 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_prehistory.yaml' 2026-09-01T00:16:58,539 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_accounting.yaml' 2026-09-01T00:16:58,540 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_law.yaml' 2026-09-01T00:16:58,542 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_medicine.yaml' 2026-09-01T00:16:58,543 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_professional_psychology.yaml' 2026-09-01T00:16:58,544 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_public_relations.yaml' 2026-09-01T00:16:58,545 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_security_studies.yaml' 2026-09-01T00:16:58,546 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_sociology.yaml' 2026-09-01T00:16:58,548 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_us_foreign_policy.yaml' 2026-09-01T00:16:58,549 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_virology.yaml' 2026-09-01T00:16:58,550 adding 'lm_eval/tasks/global_mmlu/full/es/global_mmlu_full_es_world_religions.yaml' 2026-09-01T00:16:58,551 adding 'lm_eval/tasks/global_mmlu/full/es/utils.py' 2026-09-01T00:16:58,554 adding 'lm_eval/tasks/global_mmlu/full/fa/_fa_template_yaml' 2026-09-01T00:16:58,555 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa.yaml' 2026-09-01T00:16:58,557 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_humanities.yaml' 2026-09-01T00:16:58,558 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_other.yaml' 2026-09-01T00:16:58,559 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_social_sciences.yaml' 2026-09-01T00:16:58,560 adding 'lm_eval/tasks/global_mmlu/full/fa/_global_mmlu_full_fa_stem.yaml' 2026-09-01T00:16:58,561 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_abstract_algebra.yaml' 2026-09-01T00:16:58,562 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_anatomy.yaml' 2026-09-01T00:16:58,563 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_astronomy.yaml' 2026-09-01T00:16:58,565 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_business_ethics.yaml' 2026-09-01T00:16:58,566 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_clinical_knowledge.yaml' 2026-09-01T00:16:58,567 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_biology.yaml' 2026-09-01T00:16:58,568 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_chemistry.yaml' 2026-09-01T00:16:58,569 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_computer_science.yaml' 2026-09-01T00:16:58,571 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_mathematics.yaml' 2026-09-01T00:16:58,572 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_medicine.yaml' 2026-09-01T00:16:58,573 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_college_physics.yaml' 2026-09-01T00:16:58,574 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_computer_security.yaml' 2026-09-01T00:16:58,575 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_conceptual_physics.yaml' 2026-09-01T00:16:58,577 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_econometrics.yaml' 2026-09-01T00:16:58,578 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_electrical_engineering.yaml' 2026-09-01T00:16:58,579 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_elementary_mathematics.yaml' 2026-09-01T00:16:58,580 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_formal_logic.yaml' 2026-09-01T00:16:58,581 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_global_facts.yaml' 2026-09-01T00:16:58,583 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_biology.yaml' 2026-09-01T00:16:58,584 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_chemistry.yaml' 2026-09-01T00:16:58,585 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_computer_science.yaml' 2026-09-01T00:16:58,586 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_european_history.yaml' 2026-09-01T00:16:58,587 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_geography.yaml' 2026-09-01T00:16:58,588 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,590 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,591 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_mathematics.yaml' 2026-09-01T00:16:58,592 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_microeconomics.yaml' 2026-09-01T00:16:58,593 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_physics.yaml' 2026-09-01T00:16:58,595 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_psychology.yaml' 2026-09-01T00:16:58,596 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_statistics.yaml' 2026-09-01T00:16:58,597 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_us_history.yaml' 2026-09-01T00:16:58,598 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_high_school_world_history.yaml' 2026-09-01T00:16:58,599 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_aging.yaml' 2026-09-01T00:16:58,600 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_human_sexuality.yaml' 2026-09-01T00:16:58,602 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_international_law.yaml' 2026-09-01T00:16:58,603 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_jurisprudence.yaml' 2026-09-01T00:16:58,604 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_logical_fallacies.yaml' 2026-09-01T00:16:58,605 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_machine_learning.yaml' 2026-09-01T00:16:58,606 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_management.yaml' 2026-09-01T00:16:58,607 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_marketing.yaml' 2026-09-01T00:16:58,609 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_medical_genetics.yaml' 2026-09-01T00:16:58,610 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_miscellaneous.yaml' 2026-09-01T00:16:58,611 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_disputes.yaml' 2026-09-01T00:16:58,612 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_moral_scenarios.yaml' 2026-09-01T00:16:58,613 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_nutrition.yaml' 2026-09-01T00:16:58,614 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_philosophy.yaml' 2026-09-01T00:16:58,616 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_prehistory.yaml' 2026-09-01T00:16:58,617 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_accounting.yaml' 2026-09-01T00:16:58,618 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_law.yaml' 2026-09-01T00:16:58,619 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_medicine.yaml' 2026-09-01T00:16:58,621 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_professional_psychology.yaml' 2026-09-01T00:16:58,622 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_public_relations.yaml' 2026-09-01T00:16:58,623 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_security_studies.yaml' 2026-09-01T00:16:58,626 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_sociology.yaml' 2026-09-01T00:16:58,627 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_us_foreign_policy.yaml' 2026-09-01T00:16:58,628 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_virology.yaml' 2026-09-01T00:16:58,629 adding 'lm_eval/tasks/global_mmlu/full/fa/global_mmlu_full_fa_world_religions.yaml' 2026-09-01T00:16:58,631 adding 'lm_eval/tasks/global_mmlu/full/fa/utils.py' 2026-09-01T00:16:58,634 adding 'lm_eval/tasks/global_mmlu/full/fil/_fil_template_yaml' 2026-09-01T00:16:58,635 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil.yaml' 2026-09-01T00:16:58,636 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_humanities.yaml' 2026-09-01T00:16:58,637 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_other.yaml' 2026-09-01T00:16:58,638 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_social_sciences.yaml' 2026-09-01T00:16:58,640 adding 'lm_eval/tasks/global_mmlu/full/fil/_global_mmlu_full_fil_stem.yaml' 2026-09-01T00:16:58,641 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_abstract_algebra.yaml' 2026-09-01T00:16:58,642 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_anatomy.yaml' 2026-09-01T00:16:58,643 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_astronomy.yaml' 2026-09-01T00:16:58,645 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_business_ethics.yaml' 2026-09-01T00:16:58,646 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_clinical_knowledge.yaml' 2026-09-01T00:16:58,647 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_biology.yaml' 2026-09-01T00:16:58,648 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_chemistry.yaml' 2026-09-01T00:16:58,649 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_computer_science.yaml' 2026-09-01T00:16:58,650 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_mathematics.yaml' 2026-09-01T00:16:58,651 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_medicine.yaml' 2026-09-01T00:16:58,653 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_college_physics.yaml' 2026-09-01T00:16:58,654 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_computer_security.yaml' 2026-09-01T00:16:58,655 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_conceptual_physics.yaml' 2026-09-01T00:16:58,656 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_econometrics.yaml' 2026-09-01T00:16:58,657 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_electrical_engineering.yaml' 2026-09-01T00:16:58,659 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_elementary_mathematics.yaml' 2026-09-01T00:16:58,660 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_formal_logic.yaml' 2026-09-01T00:16:58,661 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_global_facts.yaml' 2026-09-01T00:16:58,662 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_biology.yaml' 2026-09-01T00:16:58,664 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_chemistry.yaml' 2026-09-01T00:16:58,665 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_computer_science.yaml' 2026-09-01T00:16:58,666 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_european_history.yaml' 2026-09-01T00:16:58,668 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_geography.yaml' 2026-09-01T00:16:58,669 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,671 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,673 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_mathematics.yaml' 2026-09-01T00:16:58,674 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_microeconomics.yaml' 2026-09-01T00:16:58,676 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_physics.yaml' 2026-09-01T00:16:58,678 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_psychology.yaml' 2026-09-01T00:16:58,680 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_statistics.yaml' 2026-09-01T00:16:58,682 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_us_history.yaml' 2026-09-01T00:16:58,684 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_high_school_world_history.yaml' 2026-09-01T00:16:58,686 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_aging.yaml' 2026-09-01T00:16:58,688 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_human_sexuality.yaml' 2026-09-01T00:16:58,689 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_international_law.yaml' 2026-09-01T00:16:58,690 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_jurisprudence.yaml' 2026-09-01T00:16:58,691 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_logical_fallacies.yaml' 2026-09-01T00:16:58,693 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_machine_learning.yaml' 2026-09-01T00:16:58,694 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_management.yaml' 2026-09-01T00:16:58,695 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_marketing.yaml' 2026-09-01T00:16:58,696 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_medical_genetics.yaml' 2026-09-01T00:16:58,697 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_miscellaneous.yaml' 2026-09-01T00:16:58,698 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_disputes.yaml' 2026-09-01T00:16:58,700 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_moral_scenarios.yaml' 2026-09-01T00:16:58,701 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_nutrition.yaml' 2026-09-01T00:16:58,702 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_philosophy.yaml' 2026-09-01T00:16:58,703 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_prehistory.yaml' 2026-09-01T00:16:58,704 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_accounting.yaml' 2026-09-01T00:16:58,706 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_law.yaml' 2026-09-01T00:16:58,707 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_medicine.yaml' 2026-09-01T00:16:58,708 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_professional_psychology.yaml' 2026-09-01T00:16:58,709 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_public_relations.yaml' 2026-09-01T00:16:58,710 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_security_studies.yaml' 2026-09-01T00:16:58,711 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_sociology.yaml' 2026-09-01T00:16:58,712 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_us_foreign_policy.yaml' 2026-09-01T00:16:58,714 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_virology.yaml' 2026-09-01T00:16:58,715 adding 'lm_eval/tasks/global_mmlu/full/fil/global_mmlu_full_fil_world_religions.yaml' 2026-09-01T00:16:58,716 adding 'lm_eval/tasks/global_mmlu/full/fil/utils.py' 2026-09-01T00:16:58,719 adding 'lm_eval/tasks/global_mmlu/full/fr/_fr_template_yaml' 2026-09-01T00:16:58,721 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr.yaml' 2026-09-01T00:16:58,722 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_humanities.yaml' 2026-09-01T00:16:58,723 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_other.yaml' 2026-09-01T00:16:58,724 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_social_sciences.yaml' 2026-09-01T00:16:58,725 adding 'lm_eval/tasks/global_mmlu/full/fr/_global_mmlu_full_fr_stem.yaml' 2026-09-01T00:16:58,727 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_abstract_algebra.yaml' 2026-09-01T00:16:58,728 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_anatomy.yaml' 2026-09-01T00:16:58,729 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_astronomy.yaml' 2026-09-01T00:16:58,730 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_business_ethics.yaml' 2026-09-01T00:16:58,731 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_clinical_knowledge.yaml' 2026-09-01T00:16:58,732 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_biology.yaml' 2026-09-01T00:16:58,733 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_chemistry.yaml' 2026-09-01T00:16:58,734 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_computer_science.yaml' 2026-09-01T00:16:58,735 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_mathematics.yaml' 2026-09-01T00:16:58,737 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_medicine.yaml' 2026-09-01T00:16:58,738 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_college_physics.yaml' 2026-09-01T00:16:58,739 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_computer_security.yaml' 2026-09-01T00:16:58,740 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_conceptual_physics.yaml' 2026-09-01T00:16:58,741 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_econometrics.yaml' 2026-09-01T00:16:58,742 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_electrical_engineering.yaml' 2026-09-01T00:16:58,743 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_elementary_mathematics.yaml' 2026-09-01T00:16:58,745 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_formal_logic.yaml' 2026-09-01T00:16:58,746 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_global_facts.yaml' 2026-09-01T00:16:58,747 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_biology.yaml' 2026-09-01T00:16:58,748 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_chemistry.yaml' 2026-09-01T00:16:58,749 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_computer_science.yaml' 2026-09-01T00:16:58,750 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_european_history.yaml' 2026-09-01T00:16:58,752 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_geography.yaml' 2026-09-01T00:16:58,753 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,754 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,755 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_mathematics.yaml' 2026-09-01T00:16:58,756 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_microeconomics.yaml' 2026-09-01T00:16:58,758 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_physics.yaml' 2026-09-01T00:16:58,759 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_psychology.yaml' 2026-09-01T00:16:58,760 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_statistics.yaml' 2026-09-01T00:16:58,761 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_us_history.yaml' 2026-09-01T00:16:58,762 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_high_school_world_history.yaml' 2026-09-01T00:16:58,763 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_aging.yaml' 2026-09-01T00:16:58,765 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_human_sexuality.yaml' 2026-09-01T00:16:58,766 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_international_law.yaml' 2026-09-01T00:16:58,767 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_jurisprudence.yaml' 2026-09-01T00:16:58,769 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_logical_fallacies.yaml' 2026-09-01T00:16:58,770 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_machine_learning.yaml' 2026-09-01T00:16:58,771 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_management.yaml' 2026-09-01T00:16:58,772 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_marketing.yaml' 2026-09-01T00:16:58,773 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_medical_genetics.yaml' 2026-09-01T00:16:58,774 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_miscellaneous.yaml' 2026-09-01T00:16:58,775 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_disputes.yaml' 2026-09-01T00:16:58,776 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_moral_scenarios.yaml' 2026-09-01T00:16:58,778 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_nutrition.yaml' 2026-09-01T00:16:58,779 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_philosophy.yaml' 2026-09-01T00:16:58,780 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_prehistory.yaml' 2026-09-01T00:16:58,781 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_accounting.yaml' 2026-09-01T00:16:58,782 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_law.yaml' 2026-09-01T00:16:58,783 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_medicine.yaml' 2026-09-01T00:16:58,785 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_professional_psychology.yaml' 2026-09-01T00:16:58,786 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_public_relations.yaml' 2026-09-01T00:16:58,787 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_security_studies.yaml' 2026-09-01T00:16:58,788 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_sociology.yaml' 2026-09-01T00:16:58,789 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_us_foreign_policy.yaml' 2026-09-01T00:16:58,790 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_virology.yaml' 2026-09-01T00:16:58,792 adding 'lm_eval/tasks/global_mmlu/full/fr/global_mmlu_full_fr_world_religions.yaml' 2026-09-01T00:16:58,793 adding 'lm_eval/tasks/global_mmlu/full/fr/utils.py' 2026-09-01T00:16:58,796 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha.yaml' 2026-09-01T00:16:58,797 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_humanities.yaml' 2026-09-01T00:16:58,798 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_other.yaml' 2026-09-01T00:16:58,800 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_social_sciences.yaml' 2026-09-01T00:16:58,801 adding 'lm_eval/tasks/global_mmlu/full/ha/_global_mmlu_full_ha_stem.yaml' 2026-09-01T00:16:58,802 adding 'lm_eval/tasks/global_mmlu/full/ha/_ha_template_yaml' 2026-09-01T00:16:58,803 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_abstract_algebra.yaml' 2026-09-01T00:16:58,805 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_anatomy.yaml' 2026-09-01T00:16:58,806 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_astronomy.yaml' 2026-09-01T00:16:58,807 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_business_ethics.yaml' 2026-09-01T00:16:58,808 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_clinical_knowledge.yaml' 2026-09-01T00:16:58,809 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_biology.yaml' 2026-09-01T00:16:58,810 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_chemistry.yaml' 2026-09-01T00:16:58,812 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_computer_science.yaml' 2026-09-01T00:16:58,813 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_mathematics.yaml' 2026-09-01T00:16:58,814 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_medicine.yaml' 2026-09-01T00:16:58,815 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_college_physics.yaml' 2026-09-01T00:16:58,816 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_computer_security.yaml' 2026-09-01T00:16:58,817 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_conceptual_physics.yaml' 2026-09-01T00:16:58,818 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_econometrics.yaml' 2026-09-01T00:16:58,820 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_electrical_engineering.yaml' 2026-09-01T00:16:58,821 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_elementary_mathematics.yaml' 2026-09-01T00:16:58,822 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_formal_logic.yaml' 2026-09-01T00:16:58,823 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_global_facts.yaml' 2026-09-01T00:16:58,824 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_biology.yaml' 2026-09-01T00:16:58,825 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_chemistry.yaml' 2026-09-01T00:16:58,827 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_computer_science.yaml' 2026-09-01T00:16:58,828 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_european_history.yaml' 2026-09-01T00:16:58,829 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_geography.yaml' 2026-09-01T00:16:58,830 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,831 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,832 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_mathematics.yaml' 2026-09-01T00:16:58,833 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_microeconomics.yaml' 2026-09-01T00:16:58,835 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_physics.yaml' 2026-09-01T00:16:58,836 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_psychology.yaml' 2026-09-01T00:16:58,837 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_statistics.yaml' 2026-09-01T00:16:58,838 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_us_history.yaml' 2026-09-01T00:16:58,839 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_high_school_world_history.yaml' 2026-09-01T00:16:58,840 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_aging.yaml' 2026-09-01T00:16:58,842 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_human_sexuality.yaml' 2026-09-01T00:16:58,843 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_international_law.yaml' 2026-09-01T00:16:58,844 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_jurisprudence.yaml' 2026-09-01T00:16:58,845 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_logical_fallacies.yaml' 2026-09-01T00:16:58,846 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_machine_learning.yaml' 2026-09-01T00:16:58,848 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_management.yaml' 2026-09-01T00:16:58,849 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_marketing.yaml' 2026-09-01T00:16:58,850 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_medical_genetics.yaml' 2026-09-01T00:16:58,851 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_miscellaneous.yaml' 2026-09-01T00:16:58,853 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_disputes.yaml' 2026-09-01T00:16:58,854 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_moral_scenarios.yaml' 2026-09-01T00:16:58,855 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_nutrition.yaml' 2026-09-01T00:16:58,856 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_philosophy.yaml' 2026-09-01T00:16:58,857 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_prehistory.yaml' 2026-09-01T00:16:58,858 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_accounting.yaml' 2026-09-01T00:16:58,859 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_law.yaml' 2026-09-01T00:16:58,861 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_medicine.yaml' 2026-09-01T00:16:58,862 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_professional_psychology.yaml' 2026-09-01T00:16:58,863 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_public_relations.yaml' 2026-09-01T00:16:58,864 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_security_studies.yaml' 2026-09-01T00:16:58,865 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_sociology.yaml' 2026-09-01T00:16:58,866 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_us_foreign_policy.yaml' 2026-09-01T00:16:58,867 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_virology.yaml' 2026-09-01T00:16:58,868 adding 'lm_eval/tasks/global_mmlu/full/ha/global_mmlu_full_ha_world_religions.yaml' 2026-09-01T00:16:58,870 adding 'lm_eval/tasks/global_mmlu/full/ha/utils.py' 2026-09-01T00:16:58,873 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he.yaml' 2026-09-01T00:16:58,874 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_humanities.yaml' 2026-09-01T00:16:58,875 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_other.yaml' 2026-09-01T00:16:58,876 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_social_sciences.yaml' 2026-09-01T00:16:58,878 adding 'lm_eval/tasks/global_mmlu/full/he/_global_mmlu_full_he_stem.yaml' 2026-09-01T00:16:58,879 adding 'lm_eval/tasks/global_mmlu/full/he/_he_template_yaml' 2026-09-01T00:16:58,881 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_abstract_algebra.yaml' 2026-09-01T00:16:58,882 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_anatomy.yaml' 2026-09-01T00:16:58,883 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_astronomy.yaml' 2026-09-01T00:16:58,885 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_business_ethics.yaml' 2026-09-01T00:16:58,886 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_clinical_knowledge.yaml' 2026-09-01T00:16:58,888 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_biology.yaml' 2026-09-01T00:16:58,889 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_chemistry.yaml' 2026-09-01T00:16:58,891 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_computer_science.yaml' 2026-09-01T00:16:58,892 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_mathematics.yaml' 2026-09-01T00:16:58,894 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_medicine.yaml' 2026-09-01T00:16:58,895 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_college_physics.yaml' 2026-09-01T00:16:58,897 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_computer_security.yaml' 2026-09-01T00:16:58,898 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_conceptual_physics.yaml' 2026-09-01T00:16:58,900 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_econometrics.yaml' 2026-09-01T00:16:58,901 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_electrical_engineering.yaml' 2026-09-01T00:16:58,903 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_elementary_mathematics.yaml' 2026-09-01T00:16:58,904 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_formal_logic.yaml' 2026-09-01T00:16:58,906 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_global_facts.yaml' 2026-09-01T00:16:58,907 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_biology.yaml' 2026-09-01T00:16:58,909 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_chemistry.yaml' 2026-09-01T00:16:58,910 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_computer_science.yaml' 2026-09-01T00:16:58,911 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_european_history.yaml' 2026-09-01T00:16:58,913 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_geography.yaml' 2026-09-01T00:16:58,914 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_government_and_politics.yaml' 2026-09-01T00:16:58,916 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_macroeconomics.yaml' 2026-09-01T00:16:58,917 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_mathematics.yaml' 2026-09-01T00:16:58,918 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_microeconomics.yaml' 2026-09-01T00:16:58,920 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_physics.yaml' 2026-09-01T00:16:58,922 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_psychology.yaml' 2026-09-01T00:16:58,923 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_statistics.yaml' 2026-09-01T00:16:58,925 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_us_history.yaml' 2026-09-01T00:16:58,926 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_high_school_world_history.yaml' 2026-09-01T00:16:58,928 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_aging.yaml' 2026-09-01T00:16:58,929 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_human_sexuality.yaml' 2026-09-01T00:16:58,930 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_international_law.yaml' 2026-09-01T00:16:58,932 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_jurisprudence.yaml' 2026-09-01T00:16:58,933 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_logical_fallacies.yaml' 2026-09-01T00:16:58,935 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_machine_learning.yaml' 2026-09-01T00:16:58,936 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_management.yaml' 2026-09-01T00:16:58,938 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_marketing.yaml' 2026-09-01T00:16:58,939 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_medical_genetics.yaml' 2026-09-01T00:16:58,940 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_miscellaneous.yaml' 2026-09-01T00:16:58,942 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_disputes.yaml' 2026-09-01T00:16:58,943 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_moral_scenarios.yaml' 2026-09-01T00:16:58,945 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_nutrition.yaml' 2026-09-01T00:16:58,947 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_philosophy.yaml' 2026-09-01T00:16:58,948 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_prehistory.yaml' 2026-09-01T00:16:58,949 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_accounting.yaml' 2026-09-01T00:16:58,951 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_law.yaml' 2026-09-01T00:16:58,952 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_medicine.yaml' 2026-09-01T00:16:58,954 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_professional_psychology.yaml' 2026-09-01T00:16:58,955 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_public_relations.yaml' 2026-09-01T00:16:58,957 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_security_studies.yaml' 2026-09-01T00:16:58,958 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_sociology.yaml' 2026-09-01T00:16:58,960 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_us_foreign_policy.yaml' 2026-09-01T00:16:58,961 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_virology.yaml' 2026-09-01T00:16:58,963 adding 'lm_eval/tasks/global_mmlu/full/he/global_mmlu_full_he_world_religions.yaml' 2026-09-01T00:16:58,964 adding 'lm_eval/tasks/global_mmlu/full/he/utils.py' 2026-09-01T00:16:58,968 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi.yaml' 2026-09-01T00:16:58,970 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_humanities.yaml' 2026-09-01T00:16:58,971 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_other.yaml' 2026-09-01T00:16:58,973 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_social_sciences.yaml' 2026-09-01T00:16:58,974 adding 'lm_eval/tasks/global_mmlu/full/hi/_global_mmlu_full_hi_stem.yaml' 2026-09-01T00:16:58,976 adding 'lm_eval/tasks/global_mmlu/full/hi/_hi_template_yaml' 2026-09-01T00:16:58,977 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_abstract_algebra.yaml' 2026-09-01T00:16:58,978 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_anatomy.yaml' 2026-09-01T00:16:58,979 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_astronomy.yaml' 2026-09-01T00:16:58,980 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_business_ethics.yaml' 2026-09-01T00:16:58,982 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_clinical_knowledge.yaml' 2026-09-01T00:16:58,983 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_biology.yaml' 2026-09-01T00:16:58,984 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_chemistry.yaml' 2026-09-01T00:16:58,985 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_computer_science.yaml' 2026-09-01T00:16:58,986 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_mathematics.yaml' 2026-09-01T00:16:58,987 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_medicine.yaml' 2026-09-01T00:16:58,989 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_college_physics.yaml' 2026-09-01T00:16:58,990 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_computer_security.yaml' 2026-09-01T00:16:58,991 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_conceptual_physics.yaml' 2026-09-01T00:16:58,992 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_econometrics.yaml' 2026-09-01T00:16:58,993 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_electrical_engineering.yaml' 2026-09-01T00:16:58,994 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_elementary_mathematics.yaml' 2026-09-01T00:16:58,995 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_formal_logic.yaml' 2026-09-01T00:16:58,997 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_global_facts.yaml' 2026-09-01T00:16:58,998 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_biology.yaml' 2026-09-01T00:16:58,999 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_chemistry.yaml' 2026-09-01T00:16:59,000 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_computer_science.yaml' 2026-09-01T00:16:59,001 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_european_history.yaml' 2026-09-01T00:16:59,002 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_geography.yaml' 2026-09-01T00:16:59,004 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,006 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,007 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_mathematics.yaml' 2026-09-01T00:16:59,008 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_microeconomics.yaml' 2026-09-01T00:16:59,009 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_physics.yaml' 2026-09-01T00:16:59,011 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_psychology.yaml' 2026-09-01T00:16:59,012 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_statistics.yaml' 2026-09-01T00:16:59,013 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_us_history.yaml' 2026-09-01T00:16:59,014 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_high_school_world_history.yaml' 2026-09-01T00:16:59,015 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_aging.yaml' 2026-09-01T00:16:59,016 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_human_sexuality.yaml' 2026-09-01T00:16:59,017 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_international_law.yaml' 2026-09-01T00:16:59,018 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_jurisprudence.yaml' 2026-09-01T00:16:59,020 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_logical_fallacies.yaml' 2026-09-01T00:16:59,021 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_machine_learning.yaml' 2026-09-01T00:16:59,022 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_management.yaml' 2026-09-01T00:16:59,023 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_marketing.yaml' 2026-09-01T00:16:59,024 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_medical_genetics.yaml' 2026-09-01T00:16:59,025 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_miscellaneous.yaml' 2026-09-01T00:16:59,027 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_disputes.yaml' 2026-09-01T00:16:59,028 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_moral_scenarios.yaml' 2026-09-01T00:16:59,029 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_nutrition.yaml' 2026-09-01T00:16:59,030 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_philosophy.yaml' 2026-09-01T00:16:59,031 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_prehistory.yaml' 2026-09-01T00:16:59,032 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_accounting.yaml' 2026-09-01T00:16:59,034 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_law.yaml' 2026-09-01T00:16:59,035 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_medicine.yaml' 2026-09-01T00:16:59,036 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_professional_psychology.yaml' 2026-09-01T00:16:59,037 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_public_relations.yaml' 2026-09-01T00:16:59,038 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_security_studies.yaml' 2026-09-01T00:16:59,040 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_sociology.yaml' 2026-09-01T00:16:59,041 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_us_foreign_policy.yaml' 2026-09-01T00:16:59,042 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_virology.yaml' 2026-09-01T00:16:59,043 adding 'lm_eval/tasks/global_mmlu/full/hi/global_mmlu_full_hi_world_religions.yaml' 2026-09-01T00:16:59,045 adding 'lm_eval/tasks/global_mmlu/full/hi/utils.py' 2026-09-01T00:16:59,048 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id.yaml' 2026-09-01T00:16:59,049 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_humanities.yaml' 2026-09-01T00:16:59,050 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_other.yaml' 2026-09-01T00:16:59,051 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_social_sciences.yaml' 2026-09-01T00:16:59,052 adding 'lm_eval/tasks/global_mmlu/full/id/_global_mmlu_full_id_stem.yaml' 2026-09-01T00:16:59,054 adding 'lm_eval/tasks/global_mmlu/full/id/_id_template_yaml' 2026-09-01T00:16:59,055 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_abstract_algebra.yaml' 2026-09-01T00:16:59,056 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_anatomy.yaml' 2026-09-01T00:16:59,057 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_astronomy.yaml' 2026-09-01T00:16:59,059 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_business_ethics.yaml' 2026-09-01T00:16:59,060 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_clinical_knowledge.yaml' 2026-09-01T00:16:59,061 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_biology.yaml' 2026-09-01T00:16:59,062 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_chemistry.yaml' 2026-09-01T00:16:59,063 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_computer_science.yaml' 2026-09-01T00:16:59,064 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_mathematics.yaml' 2026-09-01T00:16:59,065 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_medicine.yaml' 2026-09-01T00:16:59,067 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_college_physics.yaml' 2026-09-01T00:16:59,068 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_computer_security.yaml' 2026-09-01T00:16:59,069 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_conceptual_physics.yaml' 2026-09-01T00:16:59,070 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_econometrics.yaml' 2026-09-01T00:16:59,071 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_electrical_engineering.yaml' 2026-09-01T00:16:59,072 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_elementary_mathematics.yaml' 2026-09-01T00:16:59,074 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_formal_logic.yaml' 2026-09-01T00:16:59,075 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_global_facts.yaml' 2026-09-01T00:16:59,076 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_biology.yaml' 2026-09-01T00:16:59,077 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_chemistry.yaml' 2026-09-01T00:16:59,078 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_computer_science.yaml' 2026-09-01T00:16:59,080 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_european_history.yaml' 2026-09-01T00:16:59,081 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_geography.yaml' 2026-09-01T00:16:59,082 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,083 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,084 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_mathematics.yaml' 2026-09-01T00:16:59,086 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_microeconomics.yaml' 2026-09-01T00:16:59,087 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_physics.yaml' 2026-09-01T00:16:59,088 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_psychology.yaml' 2026-09-01T00:16:59,089 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_statistics.yaml' 2026-09-01T00:16:59,090 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_us_history.yaml' 2026-09-01T00:16:59,092 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_high_school_world_history.yaml' 2026-09-01T00:16:59,093 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_aging.yaml' 2026-09-01T00:16:59,094 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_human_sexuality.yaml' 2026-09-01T00:16:59,095 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_international_law.yaml' 2026-09-01T00:16:59,097 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_jurisprudence.yaml' 2026-09-01T00:16:59,098 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_logical_fallacies.yaml' 2026-09-01T00:16:59,099 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_machine_learning.yaml' 2026-09-01T00:16:59,100 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_management.yaml' 2026-09-01T00:16:59,102 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_marketing.yaml' 2026-09-01T00:16:59,103 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_medical_genetics.yaml' 2026-09-01T00:16:59,104 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_miscellaneous.yaml' 2026-09-01T00:16:59,105 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_disputes.yaml' 2026-09-01T00:16:59,106 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_moral_scenarios.yaml' 2026-09-01T00:16:59,107 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_nutrition.yaml' 2026-09-01T00:16:59,108 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_philosophy.yaml' 2026-09-01T00:16:59,110 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_prehistory.yaml' 2026-09-01T00:16:59,111 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_accounting.yaml' 2026-09-01T00:16:59,112 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_law.yaml' 2026-09-01T00:16:59,113 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_medicine.yaml' 2026-09-01T00:16:59,114 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_professional_psychology.yaml' 2026-09-01T00:16:59,115 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_public_relations.yaml' 2026-09-01T00:16:59,117 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_security_studies.yaml' 2026-09-01T00:16:59,118 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_sociology.yaml' 2026-09-01T00:16:59,119 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_us_foreign_policy.yaml' 2026-09-01T00:16:59,120 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_virology.yaml' 2026-09-01T00:16:59,121 adding 'lm_eval/tasks/global_mmlu/full/id/global_mmlu_full_id_world_religions.yaml' 2026-09-01T00:16:59,122 adding 'lm_eval/tasks/global_mmlu/full/id/utils.py' 2026-09-01T00:16:59,126 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig.yaml' 2026-09-01T00:16:59,127 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_humanities.yaml' 2026-09-01T00:16:59,128 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_other.yaml' 2026-09-01T00:16:59,129 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_social_sciences.yaml' 2026-09-01T00:16:59,130 adding 'lm_eval/tasks/global_mmlu/full/ig/_global_mmlu_full_ig_stem.yaml' 2026-09-01T00:16:59,132 adding 'lm_eval/tasks/global_mmlu/full/ig/_ig_template_yaml' 2026-09-01T00:16:59,133 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_abstract_algebra.yaml' 2026-09-01T00:16:59,134 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_anatomy.yaml' 2026-09-01T00:16:59,135 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_astronomy.yaml' 2026-09-01T00:16:59,136 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_business_ethics.yaml' 2026-09-01T00:16:59,137 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_clinical_knowledge.yaml' 2026-09-01T00:16:59,139 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_biology.yaml' 2026-09-01T00:16:59,140 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_chemistry.yaml' 2026-09-01T00:16:59,141 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_computer_science.yaml' 2026-09-01T00:16:59,142 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_mathematics.yaml' 2026-09-01T00:16:59,143 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_medicine.yaml' 2026-09-01T00:16:59,145 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_college_physics.yaml' 2026-09-01T00:16:59,146 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_computer_security.yaml' 2026-09-01T00:16:59,147 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_conceptual_physics.yaml' 2026-09-01T00:16:59,148 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_econometrics.yaml' 2026-09-01T00:16:59,149 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_electrical_engineering.yaml' 2026-09-01T00:16:59,150 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_elementary_mathematics.yaml' 2026-09-01T00:16:59,151 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_formal_logic.yaml' 2026-09-01T00:16:59,152 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_global_facts.yaml' 2026-09-01T00:16:59,153 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_biology.yaml' 2026-09-01T00:16:59,154 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_chemistry.yaml' 2026-09-01T00:16:59,156 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_computer_science.yaml' 2026-09-01T00:16:59,157 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_european_history.yaml' 2026-09-01T00:16:59,158 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_geography.yaml' 2026-09-01T00:16:59,159 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,160 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,161 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_mathematics.yaml' 2026-09-01T00:16:59,162 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_microeconomics.yaml' 2026-09-01T00:16:59,163 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_physics.yaml' 2026-09-01T00:16:59,164 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_psychology.yaml' 2026-09-01T00:16:59,166 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_statistics.yaml' 2026-09-01T00:16:59,167 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_us_history.yaml' 2026-09-01T00:16:59,168 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_high_school_world_history.yaml' 2026-09-01T00:16:59,169 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_aging.yaml' 2026-09-01T00:16:59,170 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_human_sexuality.yaml' 2026-09-01T00:16:59,171 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_international_law.yaml' 2026-09-01T00:16:59,173 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_jurisprudence.yaml' 2026-09-01T00:16:59,174 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_logical_fallacies.yaml' 2026-09-01T00:16:59,175 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_machine_learning.yaml' 2026-09-01T00:16:59,176 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_management.yaml' 2026-09-01T00:16:59,177 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_marketing.yaml' 2026-09-01T00:16:59,179 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_medical_genetics.yaml' 2026-09-01T00:16:59,180 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_miscellaneous.yaml' 2026-09-01T00:16:59,181 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_disputes.yaml' 2026-09-01T00:16:59,182 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_moral_scenarios.yaml' 2026-09-01T00:16:59,183 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_nutrition.yaml' 2026-09-01T00:16:59,185 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_philosophy.yaml' 2026-09-01T00:16:59,186 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_prehistory.yaml' 2026-09-01T00:16:59,187 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_accounting.yaml' 2026-09-01T00:16:59,189 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_law.yaml' 2026-09-01T00:16:59,190 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_medicine.yaml' 2026-09-01T00:16:59,191 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_professional_psychology.yaml' 2026-09-01T00:16:59,192 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_public_relations.yaml' 2026-09-01T00:16:59,194 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_security_studies.yaml' 2026-09-01T00:16:59,195 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_sociology.yaml' 2026-09-01T00:16:59,196 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_us_foreign_policy.yaml' 2026-09-01T00:16:59,197 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_virology.yaml' 2026-09-01T00:16:59,198 adding 'lm_eval/tasks/global_mmlu/full/ig/global_mmlu_full_ig_world_religions.yaml' 2026-09-01T00:16:59,200 adding 'lm_eval/tasks/global_mmlu/full/ig/utils.py' 2026-09-01T00:16:59,203 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it.yaml' 2026-09-01T00:16:59,204 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_humanities.yaml' 2026-09-01T00:16:59,205 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_other.yaml' 2026-09-01T00:16:59,207 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_social_sciences.yaml' 2026-09-01T00:16:59,208 adding 'lm_eval/tasks/global_mmlu/full/it/_global_mmlu_full_it_stem.yaml' 2026-09-01T00:16:59,209 adding 'lm_eval/tasks/global_mmlu/full/it/_it_template_yaml' 2026-09-01T00:16:59,210 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_abstract_algebra.yaml' 2026-09-01T00:16:59,212 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_anatomy.yaml' 2026-09-01T00:16:59,213 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_astronomy.yaml' 2026-09-01T00:16:59,214 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_business_ethics.yaml' 2026-09-01T00:16:59,215 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_clinical_knowledge.yaml' 2026-09-01T00:16:59,216 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_biology.yaml' 2026-09-01T00:16:59,218 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_chemistry.yaml' 2026-09-01T00:16:59,219 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_computer_science.yaml' 2026-09-01T00:16:59,220 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_mathematics.yaml' 2026-09-01T00:16:59,221 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_medicine.yaml' 2026-09-01T00:16:59,222 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_college_physics.yaml' 2026-09-01T00:16:59,224 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_computer_security.yaml' 2026-09-01T00:16:59,225 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_conceptual_physics.yaml' 2026-09-01T00:16:59,226 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_econometrics.yaml' 2026-09-01T00:16:59,227 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_electrical_engineering.yaml' 2026-09-01T00:16:59,228 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_elementary_mathematics.yaml' 2026-09-01T00:16:59,230 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_formal_logic.yaml' 2026-09-01T00:16:59,231 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_global_facts.yaml' 2026-09-01T00:16:59,232 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_biology.yaml' 2026-09-01T00:16:59,233 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_chemistry.yaml' 2026-09-01T00:16:59,235 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_computer_science.yaml' 2026-09-01T00:16:59,236 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_european_history.yaml' 2026-09-01T00:16:59,237 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_geography.yaml' 2026-09-01T00:16:59,238 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,239 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,240 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_mathematics.yaml' 2026-09-01T00:16:59,241 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_microeconomics.yaml' 2026-09-01T00:16:59,242 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_physics.yaml' 2026-09-01T00:16:59,243 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_psychology.yaml' 2026-09-01T00:16:59,245 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_statistics.yaml' 2026-09-01T00:16:59,246 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_us_history.yaml' 2026-09-01T00:16:59,247 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_high_school_world_history.yaml' 2026-09-01T00:16:59,248 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_aging.yaml' 2026-09-01T00:16:59,249 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_human_sexuality.yaml' 2026-09-01T00:16:59,250 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_international_law.yaml' 2026-09-01T00:16:59,251 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_jurisprudence.yaml' 2026-09-01T00:16:59,253 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_logical_fallacies.yaml' 2026-09-01T00:16:59,254 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_machine_learning.yaml' 2026-09-01T00:16:59,255 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_management.yaml' 2026-09-01T00:16:59,256 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_marketing.yaml' 2026-09-01T00:16:59,257 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_medical_genetics.yaml' 2026-09-01T00:16:59,259 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_miscellaneous.yaml' 2026-09-01T00:16:59,260 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_disputes.yaml' 2026-09-01T00:16:59,261 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_moral_scenarios.yaml' 2026-09-01T00:16:59,262 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_nutrition.yaml' 2026-09-01T00:16:59,263 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_philosophy.yaml' 2026-09-01T00:16:59,265 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_prehistory.yaml' 2026-09-01T00:16:59,266 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_accounting.yaml' 2026-09-01T00:16:59,267 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_law.yaml' 2026-09-01T00:16:59,268 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_medicine.yaml' 2026-09-01T00:16:59,270 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_professional_psychology.yaml' 2026-09-01T00:16:59,271 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_public_relations.yaml' 2026-09-01T00:16:59,272 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_security_studies.yaml' 2026-09-01T00:16:59,273 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_sociology.yaml' 2026-09-01T00:16:59,274 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_us_foreign_policy.yaml' 2026-09-01T00:16:59,276 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_virology.yaml' 2026-09-01T00:16:59,277 adding 'lm_eval/tasks/global_mmlu/full/it/global_mmlu_full_it_world_religions.yaml' 2026-09-01T00:16:59,278 adding 'lm_eval/tasks/global_mmlu/full/it/utils.py' 2026-09-01T00:16:59,281 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja.yaml' 2026-09-01T00:16:59,282 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_humanities.yaml' 2026-09-01T00:16:59,283 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_other.yaml' 2026-09-01T00:16:59,284 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_social_sciences.yaml' 2026-09-01T00:16:59,286 adding 'lm_eval/tasks/global_mmlu/full/ja/_global_mmlu_full_ja_stem.yaml' 2026-09-01T00:16:59,287 adding 'lm_eval/tasks/global_mmlu/full/ja/_ja_template_yaml' 2026-09-01T00:16:59,288 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_abstract_algebra.yaml' 2026-09-01T00:16:59,289 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_anatomy.yaml' 2026-09-01T00:16:59,290 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_astronomy.yaml' 2026-09-01T00:16:59,291 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_business_ethics.yaml' 2026-09-01T00:16:59,293 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_clinical_knowledge.yaml' 2026-09-01T00:16:59,294 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_biology.yaml' 2026-09-01T00:16:59,295 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_chemistry.yaml' 2026-09-01T00:16:59,296 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_computer_science.yaml' 2026-09-01T00:16:59,297 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_mathematics.yaml' 2026-09-01T00:16:59,299 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_medicine.yaml' 2026-09-01T00:16:59,300 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_college_physics.yaml' 2026-09-01T00:16:59,301 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_computer_security.yaml' 2026-09-01T00:16:59,302 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_conceptual_physics.yaml' 2026-09-01T00:16:59,303 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_econometrics.yaml' 2026-09-01T00:16:59,304 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_electrical_engineering.yaml' 2026-09-01T00:16:59,305 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_elementary_mathematics.yaml' 2026-09-01T00:16:59,307 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_formal_logic.yaml' 2026-09-01T00:16:59,308 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_global_facts.yaml' 2026-09-01T00:16:59,309 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_biology.yaml' 2026-09-01T00:16:59,310 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_chemistry.yaml' 2026-09-01T00:16:59,311 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_computer_science.yaml' 2026-09-01T00:16:59,313 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_european_history.yaml' 2026-09-01T00:16:59,314 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_geography.yaml' 2026-09-01T00:16:59,315 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,316 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,317 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_mathematics.yaml' 2026-09-01T00:16:59,319 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_microeconomics.yaml' 2026-09-01T00:16:59,320 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_physics.yaml' 2026-09-01T00:16:59,321 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_psychology.yaml' 2026-09-01T00:16:59,322 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_statistics.yaml' 2026-09-01T00:16:59,323 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_us_history.yaml' 2026-09-01T00:16:59,325 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_high_school_world_history.yaml' 2026-09-01T00:16:59,326 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_aging.yaml' 2026-09-01T00:16:59,327 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_human_sexuality.yaml' 2026-09-01T00:16:59,328 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_international_law.yaml' 2026-09-01T00:16:59,329 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_jurisprudence.yaml' 2026-09-01T00:16:59,331 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_logical_fallacies.yaml' 2026-09-01T00:16:59,332 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_machine_learning.yaml' 2026-09-01T00:16:59,333 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_management.yaml' 2026-09-01T00:16:59,334 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_marketing.yaml' 2026-09-01T00:16:59,335 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_medical_genetics.yaml' 2026-09-01T00:16:59,336 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_miscellaneous.yaml' 2026-09-01T00:16:59,338 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_disputes.yaml' 2026-09-01T00:16:59,339 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_moral_scenarios.yaml' 2026-09-01T00:16:59,340 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_nutrition.yaml' 2026-09-01T00:16:59,341 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_philosophy.yaml' 2026-09-01T00:16:59,342 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_prehistory.yaml' 2026-09-01T00:16:59,343 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_accounting.yaml' 2026-09-01T00:16:59,345 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_law.yaml' 2026-09-01T00:16:59,346 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_medicine.yaml' 2026-09-01T00:16:59,347 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_professional_psychology.yaml' 2026-09-01T00:16:59,348 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_public_relations.yaml' 2026-09-01T00:16:59,349 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_security_studies.yaml' 2026-09-01T00:16:59,350 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_sociology.yaml' 2026-09-01T00:16:59,352 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_us_foreign_policy.yaml' 2026-09-01T00:16:59,353 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_virology.yaml' 2026-09-01T00:16:59,354 adding 'lm_eval/tasks/global_mmlu/full/ja/global_mmlu_full_ja_world_religions.yaml' 2026-09-01T00:16:59,355 adding 'lm_eval/tasks/global_mmlu/full/ja/utils.py' 2026-09-01T00:16:59,358 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko.yaml' 2026-09-01T00:16:59,360 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_humanities.yaml' 2026-09-01T00:16:59,361 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_other.yaml' 2026-09-01T00:16:59,362 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_social_sciences.yaml' 2026-09-01T00:16:59,363 adding 'lm_eval/tasks/global_mmlu/full/ko/_global_mmlu_full_ko_stem.yaml' 2026-09-01T00:16:59,364 adding 'lm_eval/tasks/global_mmlu/full/ko/_ko_template_yaml' 2026-09-01T00:16:59,366 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_abstract_algebra.yaml' 2026-09-01T00:16:59,367 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_anatomy.yaml' 2026-09-01T00:16:59,368 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_astronomy.yaml' 2026-09-01T00:16:59,369 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_business_ethics.yaml' 2026-09-01T00:16:59,370 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_clinical_knowledge.yaml' 2026-09-01T00:16:59,372 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_biology.yaml' 2026-09-01T00:16:59,373 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_chemistry.yaml' 2026-09-01T00:16:59,374 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_computer_science.yaml' 2026-09-01T00:16:59,375 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_mathematics.yaml' 2026-09-01T00:16:59,376 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_medicine.yaml' 2026-09-01T00:16:59,377 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_college_physics.yaml' 2026-09-01T00:16:59,378 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_computer_security.yaml' 2026-09-01T00:16:59,379 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_conceptual_physics.yaml' 2026-09-01T00:16:59,381 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_econometrics.yaml' 2026-09-01T00:16:59,382 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_electrical_engineering.yaml' 2026-09-01T00:16:59,383 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_elementary_mathematics.yaml' 2026-09-01T00:16:59,384 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_formal_logic.yaml' 2026-09-01T00:16:59,385 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_global_facts.yaml' 2026-09-01T00:16:59,386 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_biology.yaml' 2026-09-01T00:16:59,387 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_chemistry.yaml' 2026-09-01T00:16:59,388 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_computer_science.yaml' 2026-09-01T00:16:59,390 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_european_history.yaml' 2026-09-01T00:16:59,391 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_geography.yaml' 2026-09-01T00:16:59,392 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,393 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,394 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_mathematics.yaml' 2026-09-01T00:16:59,395 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_microeconomics.yaml' 2026-09-01T00:16:59,397 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_physics.yaml' 2026-09-01T00:16:59,398 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_psychology.yaml' 2026-09-01T00:16:59,399 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_statistics.yaml' 2026-09-01T00:16:59,400 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_us_history.yaml' 2026-09-01T00:16:59,401 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_high_school_world_history.yaml' 2026-09-01T00:16:59,403 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_aging.yaml' 2026-09-01T00:16:59,404 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_human_sexuality.yaml' 2026-09-01T00:16:59,405 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_international_law.yaml' 2026-09-01T00:16:59,406 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_jurisprudence.yaml' 2026-09-01T00:16:59,407 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_logical_fallacies.yaml' 2026-09-01T00:16:59,409 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_machine_learning.yaml' 2026-09-01T00:16:59,410 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_management.yaml' 2026-09-01T00:16:59,411 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_marketing.yaml' 2026-09-01T00:16:59,412 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_medical_genetics.yaml' 2026-09-01T00:16:59,413 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_miscellaneous.yaml' 2026-09-01T00:16:59,415 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_disputes.yaml' 2026-09-01T00:16:59,416 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_moral_scenarios.yaml' 2026-09-01T00:16:59,417 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_nutrition.yaml' 2026-09-01T00:16:59,418 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_philosophy.yaml' 2026-09-01T00:16:59,419 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_prehistory.yaml' 2026-09-01T00:16:59,420 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_accounting.yaml' 2026-09-01T00:16:59,421 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_law.yaml' 2026-09-01T00:16:59,422 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_medicine.yaml' 2026-09-01T00:16:59,423 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_professional_psychology.yaml' 2026-09-01T00:16:59,424 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_public_relations.yaml' 2026-09-01T00:16:59,426 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_security_studies.yaml' 2026-09-01T00:16:59,427 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_sociology.yaml' 2026-09-01T00:16:59,428 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_us_foreign_policy.yaml' 2026-09-01T00:16:59,429 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_virology.yaml' 2026-09-01T00:16:59,430 adding 'lm_eval/tasks/global_mmlu/full/ko/global_mmlu_full_ko_world_religions.yaml' 2026-09-01T00:16:59,432 adding 'lm_eval/tasks/global_mmlu/full/ko/utils.py' 2026-09-01T00:16:59,435 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky.yaml' 2026-09-01T00:16:59,436 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_humanities.yaml' 2026-09-01T00:16:59,437 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_other.yaml' 2026-09-01T00:16:59,438 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_social_sciences.yaml' 2026-09-01T00:16:59,439 adding 'lm_eval/tasks/global_mmlu/full/ky/_global_mmlu_full_ky_stem.yaml' 2026-09-01T00:16:59,440 adding 'lm_eval/tasks/global_mmlu/full/ky/_ky_template_yaml' 2026-09-01T00:16:59,442 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_abstract_algebra.yaml' 2026-09-01T00:16:59,443 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_anatomy.yaml' 2026-09-01T00:16:59,444 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_astronomy.yaml' 2026-09-01T00:16:59,445 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_business_ethics.yaml' 2026-09-01T00:16:59,447 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_clinical_knowledge.yaml' 2026-09-01T00:16:59,448 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_biology.yaml' 2026-09-01T00:16:59,449 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_chemistry.yaml' 2026-09-01T00:16:59,450 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_computer_science.yaml' 2026-09-01T00:16:59,451 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_mathematics.yaml' 2026-09-01T00:16:59,452 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_medicine.yaml' 2026-09-01T00:16:59,454 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_college_physics.yaml' 2026-09-01T00:16:59,455 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_computer_security.yaml' 2026-09-01T00:16:59,456 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_conceptual_physics.yaml' 2026-09-01T00:16:59,457 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_econometrics.yaml' 2026-09-01T00:16:59,459 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_electrical_engineering.yaml' 2026-09-01T00:16:59,460 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_elementary_mathematics.yaml' 2026-09-01T00:16:59,461 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_formal_logic.yaml' 2026-09-01T00:16:59,462 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_global_facts.yaml' 2026-09-01T00:16:59,463 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_biology.yaml' 2026-09-01T00:16:59,464 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_chemistry.yaml' 2026-09-01T00:16:59,465 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_computer_science.yaml' 2026-09-01T00:16:59,467 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_european_history.yaml' 2026-09-01T00:16:59,468 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_geography.yaml' 2026-09-01T00:16:59,469 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,470 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,471 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_mathematics.yaml' 2026-09-01T00:16:59,472 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_microeconomics.yaml' 2026-09-01T00:16:59,474 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_physics.yaml' 2026-09-01T00:16:59,475 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_psychology.yaml' 2026-09-01T00:16:59,476 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_statistics.yaml' 2026-09-01T00:16:59,477 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_us_history.yaml' 2026-09-01T00:16:59,478 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_high_school_world_history.yaml' 2026-09-01T00:16:59,479 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_aging.yaml' 2026-09-01T00:16:59,481 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_human_sexuality.yaml' 2026-09-01T00:16:59,482 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_international_law.yaml' 2026-09-01T00:16:59,483 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_jurisprudence.yaml' 2026-09-01T00:16:59,484 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_logical_fallacies.yaml' 2026-09-01T00:16:59,485 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_machine_learning.yaml' 2026-09-01T00:16:59,487 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_management.yaml' 2026-09-01T00:16:59,488 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_marketing.yaml' 2026-09-01T00:16:59,489 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_medical_genetics.yaml' 2026-09-01T00:16:59,490 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_miscellaneous.yaml' 2026-09-01T00:16:59,492 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_disputes.yaml' 2026-09-01T00:16:59,493 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_moral_scenarios.yaml' 2026-09-01T00:16:59,494 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_nutrition.yaml' 2026-09-01T00:16:59,495 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_philosophy.yaml' 2026-09-01T00:16:59,497 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_prehistory.yaml' 2026-09-01T00:16:59,498 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_accounting.yaml' 2026-09-01T00:16:59,499 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_law.yaml' 2026-09-01T00:16:59,500 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_medicine.yaml' 2026-09-01T00:16:59,501 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_professional_psychology.yaml' 2026-09-01T00:16:59,503 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_public_relations.yaml' 2026-09-01T00:16:59,504 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_security_studies.yaml' 2026-09-01T00:16:59,506 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_sociology.yaml' 2026-09-01T00:16:59,507 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_us_foreign_policy.yaml' 2026-09-01T00:16:59,509 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_virology.yaml' 2026-09-01T00:16:59,510 adding 'lm_eval/tasks/global_mmlu/full/ky/global_mmlu_full_ky_world_religions.yaml' 2026-09-01T00:16:59,511 adding 'lm_eval/tasks/global_mmlu/full/ky/utils.py' 2026-09-01T00:16:59,514 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt.yaml' 2026-09-01T00:16:59,516 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_humanities.yaml' 2026-09-01T00:16:59,517 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_other.yaml' 2026-09-01T00:16:59,518 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_social_sciences.yaml' 2026-09-01T00:16:59,520 adding 'lm_eval/tasks/global_mmlu/full/lt/_global_mmlu_full_lt_stem.yaml' 2026-09-01T00:16:59,521 adding 'lm_eval/tasks/global_mmlu/full/lt/_lt_template_yaml' 2026-09-01T00:16:59,523 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_abstract_algebra.yaml' 2026-09-01T00:16:59,524 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_anatomy.yaml' 2026-09-01T00:16:59,526 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_astronomy.yaml' 2026-09-01T00:16:59,527 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_business_ethics.yaml' 2026-09-01T00:16:59,529 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_clinical_knowledge.yaml' 2026-09-01T00:16:59,530 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_biology.yaml' 2026-09-01T00:16:59,531 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_chemistry.yaml' 2026-09-01T00:16:59,533 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_computer_science.yaml' 2026-09-01T00:16:59,534 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_mathematics.yaml' 2026-09-01T00:16:59,536 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_medicine.yaml' 2026-09-01T00:16:59,537 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_college_physics.yaml' 2026-09-01T00:16:59,538 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_computer_security.yaml' 2026-09-01T00:16:59,539 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_conceptual_physics.yaml' 2026-09-01T00:16:59,540 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_econometrics.yaml' 2026-09-01T00:16:59,542 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_electrical_engineering.yaml' 2026-09-01T00:16:59,543 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_elementary_mathematics.yaml' 2026-09-01T00:16:59,544 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_formal_logic.yaml' 2026-09-01T00:16:59,545 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_global_facts.yaml' 2026-09-01T00:16:59,546 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_biology.yaml' 2026-09-01T00:16:59,548 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_chemistry.yaml' 2026-09-01T00:16:59,549 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_computer_science.yaml' 2026-09-01T00:16:59,550 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_european_history.yaml' 2026-09-01T00:16:59,551 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_geography.yaml' 2026-09-01T00:16:59,552 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,554 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,555 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_mathematics.yaml' 2026-09-01T00:16:59,556 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_microeconomics.yaml' 2026-09-01T00:16:59,557 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_physics.yaml' 2026-09-01T00:16:59,558 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_psychology.yaml' 2026-09-01T00:16:59,559 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_statistics.yaml' 2026-09-01T00:16:59,560 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_us_history.yaml' 2026-09-01T00:16:59,561 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_high_school_world_history.yaml' 2026-09-01T00:16:59,562 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_aging.yaml' 2026-09-01T00:16:59,564 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_human_sexuality.yaml' 2026-09-01T00:16:59,565 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_international_law.yaml' 2026-09-01T00:16:59,566 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_jurisprudence.yaml' 2026-09-01T00:16:59,567 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_logical_fallacies.yaml' 2026-09-01T00:16:59,568 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_machine_learning.yaml' 2026-09-01T00:16:59,570 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_management.yaml' 2026-09-01T00:16:59,571 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_marketing.yaml' 2026-09-01T00:16:59,572 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_medical_genetics.yaml' 2026-09-01T00:16:59,573 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_miscellaneous.yaml' 2026-09-01T00:16:59,574 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_disputes.yaml' 2026-09-01T00:16:59,575 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_moral_scenarios.yaml' 2026-09-01T00:16:59,577 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_nutrition.yaml' 2026-09-01T00:16:59,578 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_philosophy.yaml' 2026-09-01T00:16:59,579 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_prehistory.yaml' 2026-09-01T00:16:59,580 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_accounting.yaml' 2026-09-01T00:16:59,581 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_law.yaml' 2026-09-01T00:16:59,583 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_medicine.yaml' 2026-09-01T00:16:59,584 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_professional_psychology.yaml' 2026-09-01T00:16:59,585 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_public_relations.yaml' 2026-09-01T00:16:59,586 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_security_studies.yaml' 2026-09-01T00:16:59,587 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_sociology.yaml' 2026-09-01T00:16:59,589 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_us_foreign_policy.yaml' 2026-09-01T00:16:59,590 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_virology.yaml' 2026-09-01T00:16:59,591 adding 'lm_eval/tasks/global_mmlu/full/lt/global_mmlu_full_lt_world_religions.yaml' 2026-09-01T00:16:59,592 adding 'lm_eval/tasks/global_mmlu/full/lt/utils.py' 2026-09-01T00:16:59,595 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg.yaml' 2026-09-01T00:16:59,597 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_humanities.yaml' 2026-09-01T00:16:59,598 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_other.yaml' 2026-09-01T00:16:59,599 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_social_sciences.yaml' 2026-09-01T00:16:59,600 adding 'lm_eval/tasks/global_mmlu/full/mg/_global_mmlu_full_mg_stem.yaml' 2026-09-01T00:16:59,601 adding 'lm_eval/tasks/global_mmlu/full/mg/_mg_template_yaml' 2026-09-01T00:16:59,602 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_abstract_algebra.yaml' 2026-09-01T00:16:59,604 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_anatomy.yaml' 2026-09-01T00:16:59,605 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_astronomy.yaml' 2026-09-01T00:16:59,606 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_business_ethics.yaml' 2026-09-01T00:16:59,607 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_clinical_knowledge.yaml' 2026-09-01T00:16:59,608 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_biology.yaml' 2026-09-01T00:16:59,609 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_chemistry.yaml' 2026-09-01T00:16:59,610 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_computer_science.yaml' 2026-09-01T00:16:59,611 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_mathematics.yaml' 2026-09-01T00:16:59,613 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_medicine.yaml' 2026-09-01T00:16:59,614 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_college_physics.yaml' 2026-09-01T00:16:59,615 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_computer_security.yaml' 2026-09-01T00:16:59,616 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_conceptual_physics.yaml' 2026-09-01T00:16:59,617 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_econometrics.yaml' 2026-09-01T00:16:59,618 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_electrical_engineering.yaml' 2026-09-01T00:16:59,619 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_elementary_mathematics.yaml' 2026-09-01T00:16:59,621 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_formal_logic.yaml' 2026-09-01T00:16:59,622 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_global_facts.yaml' 2026-09-01T00:16:59,623 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_biology.yaml' 2026-09-01T00:16:59,624 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_chemistry.yaml' 2026-09-01T00:16:59,625 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_computer_science.yaml' 2026-09-01T00:16:59,627 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_european_history.yaml' 2026-09-01T00:16:59,628 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_geography.yaml' 2026-09-01T00:16:59,629 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,630 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,631 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_mathematics.yaml' 2026-09-01T00:16:59,632 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_microeconomics.yaml' 2026-09-01T00:16:59,634 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_physics.yaml' 2026-09-01T00:16:59,635 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_psychology.yaml' 2026-09-01T00:16:59,636 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_statistics.yaml' 2026-09-01T00:16:59,637 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_us_history.yaml' 2026-09-01T00:16:59,639 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_high_school_world_history.yaml' 2026-09-01T00:16:59,640 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_aging.yaml' 2026-09-01T00:16:59,641 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_human_sexuality.yaml' 2026-09-01T00:16:59,642 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_international_law.yaml' 2026-09-01T00:16:59,643 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_jurisprudence.yaml' 2026-09-01T00:16:59,645 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_logical_fallacies.yaml' 2026-09-01T00:16:59,646 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_machine_learning.yaml' 2026-09-01T00:16:59,647 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_management.yaml' 2026-09-01T00:16:59,648 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_marketing.yaml' 2026-09-01T00:16:59,649 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_medical_genetics.yaml' 2026-09-01T00:16:59,650 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_miscellaneous.yaml' 2026-09-01T00:16:59,651 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_disputes.yaml' 2026-09-01T00:16:59,652 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_moral_scenarios.yaml' 2026-09-01T00:16:59,653 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_nutrition.yaml' 2026-09-01T00:16:59,654 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_philosophy.yaml' 2026-09-01T00:16:59,656 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_prehistory.yaml' 2026-09-01T00:16:59,657 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_accounting.yaml' 2026-09-01T00:16:59,658 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_law.yaml' 2026-09-01T00:16:59,659 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_medicine.yaml' 2026-09-01T00:16:59,660 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_professional_psychology.yaml' 2026-09-01T00:16:59,662 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_public_relations.yaml' 2026-09-01T00:16:59,663 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_security_studies.yaml' 2026-09-01T00:16:59,664 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_sociology.yaml' 2026-09-01T00:16:59,665 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_us_foreign_policy.yaml' 2026-09-01T00:16:59,666 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_virology.yaml' 2026-09-01T00:16:59,668 adding 'lm_eval/tasks/global_mmlu/full/mg/global_mmlu_full_mg_world_religions.yaml' 2026-09-01T00:16:59,669 adding 'lm_eval/tasks/global_mmlu/full/mg/utils.py' 2026-09-01T00:16:59,672 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms.yaml' 2026-09-01T00:16:59,673 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_humanities.yaml' 2026-09-01T00:16:59,674 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_other.yaml' 2026-09-01T00:16:59,675 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_social_sciences.yaml' 2026-09-01T00:16:59,677 adding 'lm_eval/tasks/global_mmlu/full/ms/_global_mmlu_full_ms_stem.yaml' 2026-09-01T00:16:59,678 adding 'lm_eval/tasks/global_mmlu/full/ms/_ms_template_yaml' 2026-09-01T00:16:59,679 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_abstract_algebra.yaml' 2026-09-01T00:16:59,680 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_anatomy.yaml' 2026-09-01T00:16:59,681 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_astronomy.yaml' 2026-09-01T00:16:59,682 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_business_ethics.yaml' 2026-09-01T00:16:59,684 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_clinical_knowledge.yaml' 2026-09-01T00:16:59,685 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_biology.yaml' 2026-09-01T00:16:59,686 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_chemistry.yaml' 2026-09-01T00:16:59,687 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_computer_science.yaml' 2026-09-01T00:16:59,688 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_mathematics.yaml' 2026-09-01T00:16:59,690 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_medicine.yaml' 2026-09-01T00:16:59,691 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_college_physics.yaml' 2026-09-01T00:16:59,692 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_computer_security.yaml' 2026-09-01T00:16:59,693 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_conceptual_physics.yaml' 2026-09-01T00:16:59,694 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_econometrics.yaml' 2026-09-01T00:16:59,695 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_electrical_engineering.yaml' 2026-09-01T00:16:59,696 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_elementary_mathematics.yaml' 2026-09-01T00:16:59,697 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_formal_logic.yaml' 2026-09-01T00:16:59,698 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_global_facts.yaml' 2026-09-01T00:16:59,700 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_biology.yaml' 2026-09-01T00:16:59,701 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_chemistry.yaml' 2026-09-01T00:16:59,702 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_computer_science.yaml' 2026-09-01T00:16:59,703 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_european_history.yaml' 2026-09-01T00:16:59,704 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_geography.yaml' 2026-09-01T00:16:59,705 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,707 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,708 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_mathematics.yaml' 2026-09-01T00:16:59,709 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_microeconomics.yaml' 2026-09-01T00:16:59,710 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_physics.yaml' 2026-09-01T00:16:59,711 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_psychology.yaml' 2026-09-01T00:16:59,712 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_statistics.yaml' 2026-09-01T00:16:59,714 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_us_history.yaml' 2026-09-01T00:16:59,715 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_high_school_world_history.yaml' 2026-09-01T00:16:59,716 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_aging.yaml' 2026-09-01T00:16:59,717 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_human_sexuality.yaml' 2026-09-01T00:16:59,719 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_international_law.yaml' 2026-09-01T00:16:59,720 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_jurisprudence.yaml' 2026-09-01T00:16:59,721 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_logical_fallacies.yaml' 2026-09-01T00:16:59,722 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_machine_learning.yaml' 2026-09-01T00:16:59,723 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_management.yaml' 2026-09-01T00:16:59,725 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_marketing.yaml' 2026-09-01T00:16:59,726 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_medical_genetics.yaml' 2026-09-01T00:16:59,727 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_miscellaneous.yaml' 2026-09-01T00:16:59,728 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_disputes.yaml' 2026-09-01T00:16:59,729 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_moral_scenarios.yaml' 2026-09-01T00:16:59,731 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_nutrition.yaml' 2026-09-01T00:16:59,732 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_philosophy.yaml' 2026-09-01T00:16:59,733 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_prehistory.yaml' 2026-09-01T00:16:59,734 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_accounting.yaml' 2026-09-01T00:16:59,735 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_law.yaml' 2026-09-01T00:16:59,736 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_medicine.yaml' 2026-09-01T00:16:59,737 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_professional_psychology.yaml' 2026-09-01T00:16:59,738 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_public_relations.yaml' 2026-09-01T00:16:59,740 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_security_studies.yaml' 2026-09-01T00:16:59,741 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_sociology.yaml' 2026-09-01T00:16:59,742 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_us_foreign_policy.yaml' 2026-09-01T00:16:59,743 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_virology.yaml' 2026-09-01T00:16:59,744 adding 'lm_eval/tasks/global_mmlu/full/ms/global_mmlu_full_ms_world_religions.yaml' 2026-09-01T00:16:59,746 adding 'lm_eval/tasks/global_mmlu/full/ms/utils.py' 2026-09-01T00:16:59,749 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne.yaml' 2026-09-01T00:16:59,750 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_humanities.yaml' 2026-09-01T00:16:59,751 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_other.yaml' 2026-09-01T00:16:59,752 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_social_sciences.yaml' 2026-09-01T00:16:59,753 adding 'lm_eval/tasks/global_mmlu/full/ne/_global_mmlu_full_ne_stem.yaml' 2026-09-01T00:16:59,754 adding 'lm_eval/tasks/global_mmlu/full/ne/_ne_template_yaml' 2026-09-01T00:16:59,756 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_abstract_algebra.yaml' 2026-09-01T00:16:59,757 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_anatomy.yaml' 2026-09-01T00:16:59,758 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_astronomy.yaml' 2026-09-01T00:16:59,759 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_business_ethics.yaml' 2026-09-01T00:16:59,760 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_clinical_knowledge.yaml' 2026-09-01T00:16:59,762 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_biology.yaml' 2026-09-01T00:16:59,763 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_chemistry.yaml' 2026-09-01T00:16:59,764 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_computer_science.yaml' 2026-09-01T00:16:59,765 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_mathematics.yaml' 2026-09-01T00:16:59,766 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_medicine.yaml' 2026-09-01T00:16:59,767 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_college_physics.yaml' 2026-09-01T00:16:59,769 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_computer_security.yaml' 2026-09-01T00:16:59,770 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_conceptual_physics.yaml' 2026-09-01T00:16:59,771 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_econometrics.yaml' 2026-09-01T00:16:59,772 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_electrical_engineering.yaml' 2026-09-01T00:16:59,774 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_elementary_mathematics.yaml' 2026-09-01T00:16:59,775 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_formal_logic.yaml' 2026-09-01T00:16:59,776 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_global_facts.yaml' 2026-09-01T00:16:59,777 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_biology.yaml' 2026-09-01T00:16:59,779 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_chemistry.yaml' 2026-09-01T00:16:59,780 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_computer_science.yaml' 2026-09-01T00:16:59,781 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_european_history.yaml' 2026-09-01T00:16:59,782 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_geography.yaml' 2026-09-01T00:16:59,783 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,784 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,785 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_mathematics.yaml' 2026-09-01T00:16:59,786 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_microeconomics.yaml' 2026-09-01T00:16:59,787 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_physics.yaml' 2026-09-01T00:16:59,789 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_psychology.yaml' 2026-09-01T00:16:59,790 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_statistics.yaml' 2026-09-01T00:16:59,791 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_us_history.yaml' 2026-09-01T00:16:59,792 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_high_school_world_history.yaml' 2026-09-01T00:16:59,793 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_aging.yaml' 2026-09-01T00:16:59,794 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_human_sexuality.yaml' 2026-09-01T00:16:59,796 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_international_law.yaml' 2026-09-01T00:16:59,797 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_jurisprudence.yaml' 2026-09-01T00:16:59,798 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_logical_fallacies.yaml' 2026-09-01T00:16:59,799 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_machine_learning.yaml' 2026-09-01T00:16:59,801 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_management.yaml' 2026-09-01T00:16:59,802 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_marketing.yaml' 2026-09-01T00:16:59,803 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_medical_genetics.yaml' 2026-09-01T00:16:59,804 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_miscellaneous.yaml' 2026-09-01T00:16:59,805 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_disputes.yaml' 2026-09-01T00:16:59,807 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_moral_scenarios.yaml' 2026-09-01T00:16:59,808 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_nutrition.yaml' 2026-09-01T00:16:59,809 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_philosophy.yaml' 2026-09-01T00:16:59,810 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_prehistory.yaml' 2026-09-01T00:16:59,811 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_accounting.yaml' 2026-09-01T00:16:59,813 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_law.yaml' 2026-09-01T00:16:59,814 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_medicine.yaml' 2026-09-01T00:16:59,815 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_professional_psychology.yaml' 2026-09-01T00:16:59,816 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_public_relations.yaml' 2026-09-01T00:16:59,817 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_security_studies.yaml' 2026-09-01T00:16:59,818 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_sociology.yaml' 2026-09-01T00:16:59,820 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_us_foreign_policy.yaml' 2026-09-01T00:16:59,821 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_virology.yaml' 2026-09-01T00:16:59,822 adding 'lm_eval/tasks/global_mmlu/full/ne/global_mmlu_full_ne_world_religions.yaml' 2026-09-01T00:16:59,823 adding 'lm_eval/tasks/global_mmlu/full/ne/utils.py' 2026-09-01T00:16:59,826 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl.yaml' 2026-09-01T00:16:59,828 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_humanities.yaml' 2026-09-01T00:16:59,829 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_other.yaml' 2026-09-01T00:16:59,830 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_social_sciences.yaml' 2026-09-01T00:16:59,831 adding 'lm_eval/tasks/global_mmlu/full/nl/_global_mmlu_full_nl_stem.yaml' 2026-09-01T00:16:59,832 adding 'lm_eval/tasks/global_mmlu/full/nl/_nl_template_yaml' 2026-09-01T00:16:59,833 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_abstract_algebra.yaml' 2026-09-01T00:16:59,834 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_anatomy.yaml' 2026-09-01T00:16:59,836 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_astronomy.yaml' 2026-09-01T00:16:59,837 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_business_ethics.yaml' 2026-09-01T00:16:59,838 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_clinical_knowledge.yaml' 2026-09-01T00:16:59,839 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_biology.yaml' 2026-09-01T00:16:59,840 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_chemistry.yaml' 2026-09-01T00:16:59,841 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_computer_science.yaml' 2026-09-01T00:16:59,842 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_mathematics.yaml' 2026-09-01T00:16:59,844 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_medicine.yaml' 2026-09-01T00:16:59,845 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_college_physics.yaml' 2026-09-01T00:16:59,846 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_computer_security.yaml' 2026-09-01T00:16:59,847 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_conceptual_physics.yaml' 2026-09-01T00:16:59,848 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_econometrics.yaml' 2026-09-01T00:16:59,850 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_electrical_engineering.yaml' 2026-09-01T00:16:59,851 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_elementary_mathematics.yaml' 2026-09-01T00:16:59,852 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_formal_logic.yaml' 2026-09-01T00:16:59,853 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_global_facts.yaml' 2026-09-01T00:16:59,854 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_biology.yaml' 2026-09-01T00:16:59,855 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_chemistry.yaml' 2026-09-01T00:16:59,857 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_computer_science.yaml' 2026-09-01T00:16:59,858 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_european_history.yaml' 2026-09-01T00:16:59,859 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_geography.yaml' 2026-09-01T00:16:59,860 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,862 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,863 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_mathematics.yaml' 2026-09-01T00:16:59,864 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_microeconomics.yaml' 2026-09-01T00:16:59,865 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_physics.yaml' 2026-09-01T00:16:59,867 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_psychology.yaml' 2026-09-01T00:16:59,868 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_statistics.yaml' 2026-09-01T00:16:59,869 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_us_history.yaml' 2026-09-01T00:16:59,870 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_high_school_world_history.yaml' 2026-09-01T00:16:59,871 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_aging.yaml' 2026-09-01T00:16:59,872 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_human_sexuality.yaml' 2026-09-01T00:16:59,873 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_international_law.yaml' 2026-09-01T00:16:59,874 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_jurisprudence.yaml' 2026-09-01T00:16:59,875 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_logical_fallacies.yaml' 2026-09-01T00:16:59,877 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_machine_learning.yaml' 2026-09-01T00:16:59,878 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_management.yaml' 2026-09-01T00:16:59,879 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_marketing.yaml' 2026-09-01T00:16:59,880 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_medical_genetics.yaml' 2026-09-01T00:16:59,881 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_miscellaneous.yaml' 2026-09-01T00:16:59,883 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_disputes.yaml' 2026-09-01T00:16:59,884 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_moral_scenarios.yaml' 2026-09-01T00:16:59,885 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_nutrition.yaml' 2026-09-01T00:16:59,886 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_philosophy.yaml' 2026-09-01T00:16:59,887 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_prehistory.yaml' 2026-09-01T00:16:59,888 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_accounting.yaml' 2026-09-01T00:16:59,890 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_law.yaml' 2026-09-01T00:16:59,891 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_medicine.yaml' 2026-09-01T00:16:59,892 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_professional_psychology.yaml' 2026-09-01T00:16:59,893 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_public_relations.yaml' 2026-09-01T00:16:59,894 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_security_studies.yaml' 2026-09-01T00:16:59,895 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_sociology.yaml' 2026-09-01T00:16:59,897 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_us_foreign_policy.yaml' 2026-09-01T00:16:59,898 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_virology.yaml' 2026-09-01T00:16:59,899 adding 'lm_eval/tasks/global_mmlu/full/nl/global_mmlu_full_nl_world_religions.yaml' 2026-09-01T00:16:59,900 adding 'lm_eval/tasks/global_mmlu/full/nl/utils.py' 2026-09-01T00:16:59,904 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny.yaml' 2026-09-01T00:16:59,905 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_humanities.yaml' 2026-09-01T00:16:59,906 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_other.yaml' 2026-09-01T00:16:59,907 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_social_sciences.yaml' 2026-09-01T00:16:59,908 adding 'lm_eval/tasks/global_mmlu/full/ny/_global_mmlu_full_ny_stem.yaml' 2026-09-01T00:16:59,910 adding 'lm_eval/tasks/global_mmlu/full/ny/_ny_template_yaml' 2026-09-01T00:16:59,911 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_abstract_algebra.yaml' 2026-09-01T00:16:59,912 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_anatomy.yaml' 2026-09-01T00:16:59,913 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_astronomy.yaml' 2026-09-01T00:16:59,915 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_business_ethics.yaml' 2026-09-01T00:16:59,916 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_clinical_knowledge.yaml' 2026-09-01T00:16:59,917 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_biology.yaml' 2026-09-01T00:16:59,918 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_chemistry.yaml' 2026-09-01T00:16:59,919 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_computer_science.yaml' 2026-09-01T00:16:59,920 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_mathematics.yaml' 2026-09-01T00:16:59,921 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_medicine.yaml' 2026-09-01T00:16:59,923 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_college_physics.yaml' 2026-09-01T00:16:59,924 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_computer_security.yaml' 2026-09-01T00:16:59,925 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_conceptual_physics.yaml' 2026-09-01T00:16:59,926 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_econometrics.yaml' 2026-09-01T00:16:59,927 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_electrical_engineering.yaml' 2026-09-01T00:16:59,929 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_elementary_mathematics.yaml' 2026-09-01T00:16:59,930 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_formal_logic.yaml' 2026-09-01T00:16:59,931 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_global_facts.yaml' 2026-09-01T00:16:59,932 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_biology.yaml' 2026-09-01T00:16:59,933 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_chemistry.yaml' 2026-09-01T00:16:59,934 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_computer_science.yaml' 2026-09-01T00:16:59,936 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_european_history.yaml' 2026-09-01T00:16:59,937 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_geography.yaml' 2026-09-01T00:16:59,938 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_government_and_politics.yaml' 2026-09-01T00:16:59,939 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_macroeconomics.yaml' 2026-09-01T00:16:59,940 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_mathematics.yaml' 2026-09-01T00:16:59,941 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_microeconomics.yaml' 2026-09-01T00:16:59,943 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_physics.yaml' 2026-09-01T00:16:59,944 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_psychology.yaml' 2026-09-01T00:16:59,945 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_statistics.yaml' 2026-09-01T00:16:59,946 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_us_history.yaml' 2026-09-01T00:16:59,948 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_high_school_world_history.yaml' 2026-09-01T00:16:59,949 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_aging.yaml' 2026-09-01T00:16:59,950 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_human_sexuality.yaml' 2026-09-01T00:16:59,951 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_international_law.yaml' 2026-09-01T00:16:59,952 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_jurisprudence.yaml' 2026-09-01T00:16:59,954 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_logical_fallacies.yaml' 2026-09-01T00:16:59,955 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_machine_learning.yaml' 2026-09-01T00:16:59,956 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_management.yaml' 2026-09-01T00:16:59,957 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_marketing.yaml' 2026-09-01T00:16:59,958 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_medical_genetics.yaml' 2026-09-01T00:16:59,959 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_miscellaneous.yaml' 2026-09-01T00:16:59,961 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_disputes.yaml' 2026-09-01T00:16:59,962 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_moral_scenarios.yaml' 2026-09-01T00:16:59,963 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_nutrition.yaml' 2026-09-01T00:16:59,964 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_philosophy.yaml' 2026-09-01T00:16:59,965 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_prehistory.yaml' 2026-09-01T00:16:59,966 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_accounting.yaml' 2026-09-01T00:16:59,968 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_law.yaml' 2026-09-01T00:16:59,969 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_medicine.yaml' 2026-09-01T00:16:59,970 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_professional_psychology.yaml' 2026-09-01T00:16:59,971 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_public_relations.yaml' 2026-09-01T00:16:59,972 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_security_studies.yaml' 2026-09-01T00:16:59,973 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_sociology.yaml' 2026-09-01T00:16:59,975 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_us_foreign_policy.yaml' 2026-09-01T00:16:59,976 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_virology.yaml' 2026-09-01T00:16:59,977 adding 'lm_eval/tasks/global_mmlu/full/ny/global_mmlu_full_ny_world_religions.yaml' 2026-09-01T00:16:59,978 adding 'lm_eval/tasks/global_mmlu/full/ny/utils.py' 2026-09-01T00:16:59,981 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl.yaml' 2026-09-01T00:16:59,983 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_humanities.yaml' 2026-09-01T00:16:59,984 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_other.yaml' 2026-09-01T00:16:59,985 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_social_sciences.yaml' 2026-09-01T00:16:59,986 adding 'lm_eval/tasks/global_mmlu/full/pl/_global_mmlu_full_pl_stem.yaml' 2026-09-01T00:16:59,987 adding 'lm_eval/tasks/global_mmlu/full/pl/_pl_template_yaml' 2026-09-01T00:16:59,988 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_abstract_algebra.yaml' 2026-09-01T00:16:59,990 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_anatomy.yaml' 2026-09-01T00:16:59,991 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_astronomy.yaml' 2026-09-01T00:16:59,992 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_business_ethics.yaml' 2026-09-01T00:16:59,993 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_clinical_knowledge.yaml' 2026-09-01T00:16:59,994 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_biology.yaml' 2026-09-01T00:16:59,996 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_chemistry.yaml' 2026-09-01T00:16:59,997 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_computer_science.yaml' 2026-09-01T00:16:59,998 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_mathematics.yaml' 2026-09-01T00:16:59,999 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_medicine.yaml' 2026-09-01T00:17:00,001 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_college_physics.yaml' 2026-09-01T00:17:00,002 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_computer_security.yaml' 2026-09-01T00:17:00,003 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_conceptual_physics.yaml' 2026-09-01T00:17:00,004 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_econometrics.yaml' 2026-09-01T00:17:00,005 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_electrical_engineering.yaml' 2026-09-01T00:17:00,006 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_elementary_mathematics.yaml' 2026-09-01T00:17:00,007 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_formal_logic.yaml' 2026-09-01T00:17:00,008 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_global_facts.yaml' 2026-09-01T00:17:00,009 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_biology.yaml' 2026-09-01T00:17:00,011 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_chemistry.yaml' 2026-09-01T00:17:00,012 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_computer_science.yaml' 2026-09-01T00:17:00,013 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_european_history.yaml' 2026-09-01T00:17:00,014 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_geography.yaml' 2026-09-01T00:17:00,015 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,016 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,018 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_mathematics.yaml' 2026-09-01T00:17:00,019 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_microeconomics.yaml' 2026-09-01T00:17:00,020 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_physics.yaml' 2026-09-01T00:17:00,021 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_psychology.yaml' 2026-09-01T00:17:00,022 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_statistics.yaml' 2026-09-01T00:17:00,023 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_us_history.yaml' 2026-09-01T00:17:00,024 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_high_school_world_history.yaml' 2026-09-01T00:17:00,026 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_aging.yaml' 2026-09-01T00:17:00,027 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_human_sexuality.yaml' 2026-09-01T00:17:00,028 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_international_law.yaml' 2026-09-01T00:17:00,029 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_jurisprudence.yaml' 2026-09-01T00:17:00,030 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_logical_fallacies.yaml' 2026-09-01T00:17:00,031 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_machine_learning.yaml' 2026-09-01T00:17:00,033 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_management.yaml' 2026-09-01T00:17:00,034 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_marketing.yaml' 2026-09-01T00:17:00,035 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_medical_genetics.yaml' 2026-09-01T00:17:00,036 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_miscellaneous.yaml' 2026-09-01T00:17:00,037 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_disputes.yaml' 2026-09-01T00:17:00,039 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_moral_scenarios.yaml' 2026-09-01T00:17:00,040 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_nutrition.yaml' 2026-09-01T00:17:00,041 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_philosophy.yaml' 2026-09-01T00:17:00,042 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_prehistory.yaml' 2026-09-01T00:17:00,043 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_accounting.yaml' 2026-09-01T00:17:00,045 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_law.yaml' 2026-09-01T00:17:00,046 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_medicine.yaml' 2026-09-01T00:17:00,047 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_professional_psychology.yaml' 2026-09-01T00:17:00,048 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_public_relations.yaml' 2026-09-01T00:17:00,049 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_security_studies.yaml' 2026-09-01T00:17:00,050 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_sociology.yaml' 2026-09-01T00:17:00,052 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_us_foreign_policy.yaml' 2026-09-01T00:17:00,053 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_virology.yaml' 2026-09-01T00:17:00,054 adding 'lm_eval/tasks/global_mmlu/full/pl/global_mmlu_full_pl_world_religions.yaml' 2026-09-01T00:17:00,055 adding 'lm_eval/tasks/global_mmlu/full/pl/utils.py' 2026-09-01T00:17:00,058 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt.yaml' 2026-09-01T00:17:00,059 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_humanities.yaml' 2026-09-01T00:17:00,061 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_other.yaml' 2026-09-01T00:17:00,062 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_social_sciences.yaml' 2026-09-01T00:17:00,063 adding 'lm_eval/tasks/global_mmlu/full/pt/_global_mmlu_full_pt_stem.yaml' 2026-09-01T00:17:00,064 adding 'lm_eval/tasks/global_mmlu/full/pt/_pt_template_yaml' 2026-09-01T00:17:00,065 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_abstract_algebra.yaml' 2026-09-01T00:17:00,067 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_anatomy.yaml' 2026-09-01T00:17:00,068 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_astronomy.yaml' 2026-09-01T00:17:00,069 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_business_ethics.yaml' 2026-09-01T00:17:00,070 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_clinical_knowledge.yaml' 2026-09-01T00:17:00,071 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_biology.yaml' 2026-09-01T00:17:00,072 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_chemistry.yaml' 2026-09-01T00:17:00,074 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_computer_science.yaml' 2026-09-01T00:17:00,075 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_mathematics.yaml' 2026-09-01T00:17:00,076 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_medicine.yaml' 2026-09-01T00:17:00,077 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_college_physics.yaml' 2026-09-01T00:17:00,078 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_computer_security.yaml' 2026-09-01T00:17:00,079 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_conceptual_physics.yaml' 2026-09-01T00:17:00,081 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_econometrics.yaml' 2026-09-01T00:17:00,082 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_electrical_engineering.yaml' 2026-09-01T00:17:00,083 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_elementary_mathematics.yaml' 2026-09-01T00:17:00,084 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_formal_logic.yaml' 2026-09-01T00:17:00,085 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_global_facts.yaml' 2026-09-01T00:17:00,087 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_biology.yaml' 2026-09-01T00:17:00,088 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_chemistry.yaml' 2026-09-01T00:17:00,089 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_computer_science.yaml' 2026-09-01T00:17:00,090 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_european_history.yaml' 2026-09-01T00:17:00,091 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_geography.yaml' 2026-09-01T00:17:00,093 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,094 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,095 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_mathematics.yaml' 2026-09-01T00:17:00,096 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_microeconomics.yaml' 2026-09-01T00:17:00,097 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_physics.yaml' 2026-09-01T00:17:00,098 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_psychology.yaml' 2026-09-01T00:17:00,099 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_statistics.yaml' 2026-09-01T00:17:00,101 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_us_history.yaml' 2026-09-01T00:17:00,102 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_high_school_world_history.yaml' 2026-09-01T00:17:00,103 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_aging.yaml' 2026-09-01T00:17:00,104 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_human_sexuality.yaml' 2026-09-01T00:17:00,105 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_international_law.yaml' 2026-09-01T00:17:00,107 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_jurisprudence.yaml' 2026-09-01T00:17:00,108 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_logical_fallacies.yaml' 2026-09-01T00:17:00,109 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_machine_learning.yaml' 2026-09-01T00:17:00,110 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_management.yaml' 2026-09-01T00:17:00,111 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_marketing.yaml' 2026-09-01T00:17:00,112 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_medical_genetics.yaml' 2026-09-01T00:17:00,113 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_miscellaneous.yaml' 2026-09-01T00:17:00,115 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_disputes.yaml' 2026-09-01T00:17:00,116 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_moral_scenarios.yaml' 2026-09-01T00:17:00,117 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_nutrition.yaml' 2026-09-01T00:17:00,118 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_philosophy.yaml' 2026-09-01T00:17:00,119 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_prehistory.yaml' 2026-09-01T00:17:00,120 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_accounting.yaml' 2026-09-01T00:17:00,122 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_law.yaml' 2026-09-01T00:17:00,123 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_medicine.yaml' 2026-09-01T00:17:00,124 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_professional_psychology.yaml' 2026-09-01T00:17:00,125 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_public_relations.yaml' 2026-09-01T00:17:00,126 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_security_studies.yaml' 2026-09-01T00:17:00,127 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_sociology.yaml' 2026-09-01T00:17:00,129 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_us_foreign_policy.yaml' 2026-09-01T00:17:00,130 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_virology.yaml' 2026-09-01T00:17:00,131 adding 'lm_eval/tasks/global_mmlu/full/pt/global_mmlu_full_pt_world_religions.yaml' 2026-09-01T00:17:00,132 adding 'lm_eval/tasks/global_mmlu/full/pt/utils.py' 2026-09-01T00:17:00,135 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro.yaml' 2026-09-01T00:17:00,137 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_humanities.yaml' 2026-09-01T00:17:00,138 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_other.yaml' 2026-09-01T00:17:00,139 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_social_sciences.yaml' 2026-09-01T00:17:00,140 adding 'lm_eval/tasks/global_mmlu/full/ro/_global_mmlu_full_ro_stem.yaml' 2026-09-01T00:17:00,141 adding 'lm_eval/tasks/global_mmlu/full/ro/_ro_template_yaml' 2026-09-01T00:17:00,143 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_abstract_algebra.yaml' 2026-09-01T00:17:00,144 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_anatomy.yaml' 2026-09-01T00:17:00,145 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_astronomy.yaml' 2026-09-01T00:17:00,146 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_business_ethics.yaml' 2026-09-01T00:17:00,147 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_clinical_knowledge.yaml' 2026-09-01T00:17:00,148 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_biology.yaml' 2026-09-01T00:17:00,150 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_chemistry.yaml' 2026-09-01T00:17:00,151 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_computer_science.yaml' 2026-09-01T00:17:00,152 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_mathematics.yaml' 2026-09-01T00:17:00,153 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_medicine.yaml' 2026-09-01T00:17:00,154 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_college_physics.yaml' 2026-09-01T00:17:00,156 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_computer_security.yaml' 2026-09-01T00:17:00,157 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_conceptual_physics.yaml' 2026-09-01T00:17:00,158 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_econometrics.yaml' 2026-09-01T00:17:00,160 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_electrical_engineering.yaml' 2026-09-01T00:17:00,161 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_elementary_mathematics.yaml' 2026-09-01T00:17:00,162 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_formal_logic.yaml' 2026-09-01T00:17:00,163 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_global_facts.yaml' 2026-09-01T00:17:00,165 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_biology.yaml' 2026-09-01T00:17:00,166 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_chemistry.yaml' 2026-09-01T00:17:00,168 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_computer_science.yaml' 2026-09-01T00:17:00,169 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_european_history.yaml' 2026-09-01T00:17:00,170 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_geography.yaml' 2026-09-01T00:17:00,172 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,173 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,174 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_mathematics.yaml' 2026-09-01T00:17:00,175 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_microeconomics.yaml' 2026-09-01T00:17:00,177 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_physics.yaml' 2026-09-01T00:17:00,178 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_psychology.yaml' 2026-09-01T00:17:00,179 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_statistics.yaml' 2026-09-01T00:17:00,180 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_us_history.yaml' 2026-09-01T00:17:00,182 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_high_school_world_history.yaml' 2026-09-01T00:17:00,183 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_aging.yaml' 2026-09-01T00:17:00,184 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_human_sexuality.yaml' 2026-09-01T00:17:00,186 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_international_law.yaml' 2026-09-01T00:17:00,187 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_jurisprudence.yaml' 2026-09-01T00:17:00,189 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_logical_fallacies.yaml' 2026-09-01T00:17:00,190 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_machine_learning.yaml' 2026-09-01T00:17:00,192 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_management.yaml' 2026-09-01T00:17:00,194 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_marketing.yaml' 2026-09-01T00:17:00,196 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_medical_genetics.yaml' 2026-09-01T00:17:00,197 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_miscellaneous.yaml' 2026-09-01T00:17:00,198 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_disputes.yaml' 2026-09-01T00:17:00,199 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_moral_scenarios.yaml' 2026-09-01T00:17:00,200 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_nutrition.yaml' 2026-09-01T00:17:00,202 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_philosophy.yaml' 2026-09-01T00:17:00,203 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_prehistory.yaml' 2026-09-01T00:17:00,204 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_accounting.yaml' 2026-09-01T00:17:00,205 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_law.yaml' 2026-09-01T00:17:00,206 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_medicine.yaml' 2026-09-01T00:17:00,207 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_professional_psychology.yaml' 2026-09-01T00:17:00,209 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_public_relations.yaml' 2026-09-01T00:17:00,210 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_security_studies.yaml' 2026-09-01T00:17:00,211 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_sociology.yaml' 2026-09-01T00:17:00,212 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_us_foreign_policy.yaml' 2026-09-01T00:17:00,213 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_virology.yaml' 2026-09-01T00:17:00,215 adding 'lm_eval/tasks/global_mmlu/full/ro/global_mmlu_full_ro_world_religions.yaml' 2026-09-01T00:17:00,216 adding 'lm_eval/tasks/global_mmlu/full/ro/utils.py' 2026-09-01T00:17:00,219 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru.yaml' 2026-09-01T00:17:00,220 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_humanities.yaml' 2026-09-01T00:17:00,221 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_other.yaml' 2026-09-01T00:17:00,222 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_social_sciences.yaml' 2026-09-01T00:17:00,224 adding 'lm_eval/tasks/global_mmlu/full/ru/_global_mmlu_full_ru_stem.yaml' 2026-09-01T00:17:00,226 adding 'lm_eval/tasks/global_mmlu/full/ru/_ru_template_yaml' 2026-09-01T00:17:00,227 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_abstract_algebra.yaml' 2026-09-01T00:17:00,228 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_anatomy.yaml' 2026-09-01T00:17:00,229 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_astronomy.yaml' 2026-09-01T00:17:00,231 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_business_ethics.yaml' 2026-09-01T00:17:00,232 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_clinical_knowledge.yaml' 2026-09-01T00:17:00,234 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_biology.yaml' 2026-09-01T00:17:00,236 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_chemistry.yaml' 2026-09-01T00:17:00,238 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_computer_science.yaml' 2026-09-01T00:17:00,240 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_mathematics.yaml' 2026-09-01T00:17:00,241 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_medicine.yaml' 2026-09-01T00:17:00,242 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_college_physics.yaml' 2026-09-01T00:17:00,243 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_computer_security.yaml' 2026-09-01T00:17:00,244 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_conceptual_physics.yaml' 2026-09-01T00:17:00,245 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_econometrics.yaml' 2026-09-01T00:17:00,246 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_electrical_engineering.yaml' 2026-09-01T00:17:00,247 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_elementary_mathematics.yaml' 2026-09-01T00:17:00,248 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_formal_logic.yaml' 2026-09-01T00:17:00,250 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_global_facts.yaml' 2026-09-01T00:17:00,251 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_biology.yaml' 2026-09-01T00:17:00,252 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_chemistry.yaml' 2026-09-01T00:17:00,253 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_computer_science.yaml' 2026-09-01T00:17:00,254 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_european_history.yaml' 2026-09-01T00:17:00,255 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_geography.yaml' 2026-09-01T00:17:00,256 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,257 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,259 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_mathematics.yaml' 2026-09-01T00:17:00,260 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_microeconomics.yaml' 2026-09-01T00:17:00,261 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_physics.yaml' 2026-09-01T00:17:00,262 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_psychology.yaml' 2026-09-01T00:17:00,263 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_statistics.yaml' 2026-09-01T00:17:00,264 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_us_history.yaml' 2026-09-01T00:17:00,266 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_high_school_world_history.yaml' 2026-09-01T00:17:00,267 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_aging.yaml' 2026-09-01T00:17:00,268 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_human_sexuality.yaml' 2026-09-01T00:17:00,269 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_international_law.yaml' 2026-09-01T00:17:00,270 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_jurisprudence.yaml' 2026-09-01T00:17:00,271 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_logical_fallacies.yaml' 2026-09-01T00:17:00,273 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_machine_learning.yaml' 2026-09-01T00:17:00,274 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_management.yaml' 2026-09-01T00:17:00,275 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_marketing.yaml' 2026-09-01T00:17:00,276 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_medical_genetics.yaml' 2026-09-01T00:17:00,277 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_miscellaneous.yaml' 2026-09-01T00:17:00,279 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_disputes.yaml' 2026-09-01T00:17:00,280 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_moral_scenarios.yaml' 2026-09-01T00:17:00,281 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_nutrition.yaml' 2026-09-01T00:17:00,282 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_philosophy.yaml' 2026-09-01T00:17:00,283 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_prehistory.yaml' 2026-09-01T00:17:00,284 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_accounting.yaml' 2026-09-01T00:17:00,285 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_law.yaml' 2026-09-01T00:17:00,286 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_medicine.yaml' 2026-09-01T00:17:00,287 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_professional_psychology.yaml' 2026-09-01T00:17:00,288 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_public_relations.yaml' 2026-09-01T00:17:00,290 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_security_studies.yaml' 2026-09-01T00:17:00,291 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_sociology.yaml' 2026-09-01T00:17:00,292 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_us_foreign_policy.yaml' 2026-09-01T00:17:00,293 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_virology.yaml' 2026-09-01T00:17:00,294 adding 'lm_eval/tasks/global_mmlu/full/ru/global_mmlu_full_ru_world_religions.yaml' 2026-09-01T00:17:00,295 adding 'lm_eval/tasks/global_mmlu/full/ru/utils.py' 2026-09-01T00:17:00,298 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si.yaml' 2026-09-01T00:17:00,299 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_humanities.yaml' 2026-09-01T00:17:00,301 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_other.yaml' 2026-09-01T00:17:00,302 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_social_sciences.yaml' 2026-09-01T00:17:00,303 adding 'lm_eval/tasks/global_mmlu/full/si/_global_mmlu_full_si_stem.yaml' 2026-09-01T00:17:00,304 adding 'lm_eval/tasks/global_mmlu/full/si/_si_template_yaml' 2026-09-01T00:17:00,305 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_abstract_algebra.yaml' 2026-09-01T00:17:00,306 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_anatomy.yaml' 2026-09-01T00:17:00,307 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_astronomy.yaml' 2026-09-01T00:17:00,309 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_business_ethics.yaml' 2026-09-01T00:17:00,310 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_clinical_knowledge.yaml' 2026-09-01T00:17:00,311 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_biology.yaml' 2026-09-01T00:17:00,312 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_chemistry.yaml' 2026-09-01T00:17:00,313 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_computer_science.yaml' 2026-09-01T00:17:00,314 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_mathematics.yaml' 2026-09-01T00:17:00,316 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_medicine.yaml' 2026-09-01T00:17:00,317 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_college_physics.yaml' 2026-09-01T00:17:00,318 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_computer_security.yaml' 2026-09-01T00:17:00,319 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_conceptual_physics.yaml' 2026-09-01T00:17:00,320 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_econometrics.yaml' 2026-09-01T00:17:00,321 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_electrical_engineering.yaml' 2026-09-01T00:17:00,323 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_elementary_mathematics.yaml' 2026-09-01T00:17:00,324 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_formal_logic.yaml' 2026-09-01T00:17:00,325 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_global_facts.yaml' 2026-09-01T00:17:00,326 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_biology.yaml' 2026-09-01T00:17:00,327 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_chemistry.yaml' 2026-09-01T00:17:00,328 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_computer_science.yaml' 2026-09-01T00:17:00,329 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_european_history.yaml' 2026-09-01T00:17:00,330 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_geography.yaml' 2026-09-01T00:17:00,331 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,332 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,334 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_mathematics.yaml' 2026-09-01T00:17:00,335 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_microeconomics.yaml' 2026-09-01T00:17:00,336 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_physics.yaml' 2026-09-01T00:17:00,337 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_psychology.yaml' 2026-09-01T00:17:00,338 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_statistics.yaml' 2026-09-01T00:17:00,339 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_us_history.yaml' 2026-09-01T00:17:00,341 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_high_school_world_history.yaml' 2026-09-01T00:17:00,342 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_aging.yaml' 2026-09-01T00:17:00,343 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_human_sexuality.yaml' 2026-09-01T00:17:00,344 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_international_law.yaml' 2026-09-01T00:17:00,345 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_jurisprudence.yaml' 2026-09-01T00:17:00,347 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_logical_fallacies.yaml' 2026-09-01T00:17:00,348 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_machine_learning.yaml' 2026-09-01T00:17:00,349 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_management.yaml' 2026-09-01T00:17:00,351 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_marketing.yaml' 2026-09-01T00:17:00,352 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_medical_genetics.yaml' 2026-09-01T00:17:00,354 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_miscellaneous.yaml' 2026-09-01T00:17:00,355 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_disputes.yaml' 2026-09-01T00:17:00,357 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_moral_scenarios.yaml' 2026-09-01T00:17:00,358 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_nutrition.yaml' 2026-09-01T00:17:00,359 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_philosophy.yaml' 2026-09-01T00:17:00,360 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_prehistory.yaml' 2026-09-01T00:17:00,361 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_accounting.yaml' 2026-09-01T00:17:00,362 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_law.yaml' 2026-09-01T00:17:00,363 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_medicine.yaml' 2026-09-01T00:17:00,365 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_professional_psychology.yaml' 2026-09-01T00:17:00,366 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_public_relations.yaml' 2026-09-01T00:17:00,367 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_security_studies.yaml' 2026-09-01T00:17:00,368 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_sociology.yaml' 2026-09-01T00:17:00,369 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_us_foreign_policy.yaml' 2026-09-01T00:17:00,370 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_virology.yaml' 2026-09-01T00:17:00,372 adding 'lm_eval/tasks/global_mmlu/full/si/global_mmlu_full_si_world_religions.yaml' 2026-09-01T00:17:00,373 adding 'lm_eval/tasks/global_mmlu/full/si/utils.py' 2026-09-01T00:17:00,376 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn.yaml' 2026-09-01T00:17:00,377 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_humanities.yaml' 2026-09-01T00:17:00,378 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_other.yaml' 2026-09-01T00:17:00,379 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_social_sciences.yaml' 2026-09-01T00:17:00,380 adding 'lm_eval/tasks/global_mmlu/full/sn/_global_mmlu_full_sn_stem.yaml' 2026-09-01T00:17:00,382 adding 'lm_eval/tasks/global_mmlu/full/sn/_sn_template_yaml' 2026-09-01T00:17:00,383 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_abstract_algebra.yaml' 2026-09-01T00:17:00,384 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_anatomy.yaml' 2026-09-01T00:17:00,385 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_astronomy.yaml' 2026-09-01T00:17:00,386 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_business_ethics.yaml' 2026-09-01T00:17:00,387 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_clinical_knowledge.yaml' 2026-09-01T00:17:00,388 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_biology.yaml' 2026-09-01T00:17:00,389 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_chemistry.yaml' 2026-09-01T00:17:00,390 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_computer_science.yaml' 2026-09-01T00:17:00,392 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_mathematics.yaml' 2026-09-01T00:17:00,393 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_medicine.yaml' 2026-09-01T00:17:00,394 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_college_physics.yaml' 2026-09-01T00:17:00,395 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_computer_security.yaml' 2026-09-01T00:17:00,396 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_conceptual_physics.yaml' 2026-09-01T00:17:00,397 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_econometrics.yaml' 2026-09-01T00:17:00,399 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_electrical_engineering.yaml' 2026-09-01T00:17:00,400 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_elementary_mathematics.yaml' 2026-09-01T00:17:00,401 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_formal_logic.yaml' 2026-09-01T00:17:00,402 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_global_facts.yaml' 2026-09-01T00:17:00,403 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_biology.yaml' 2026-09-01T00:17:00,404 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_chemistry.yaml' 2026-09-01T00:17:00,406 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_computer_science.yaml' 2026-09-01T00:17:00,407 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_european_history.yaml' 2026-09-01T00:17:00,408 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_geography.yaml' 2026-09-01T00:17:00,409 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,411 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,412 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_mathematics.yaml' 2026-09-01T00:17:00,413 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_microeconomics.yaml' 2026-09-01T00:17:00,414 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_physics.yaml' 2026-09-01T00:17:00,415 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_psychology.yaml' 2026-09-01T00:17:00,417 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_statistics.yaml' 2026-09-01T00:17:00,418 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_us_history.yaml' 2026-09-01T00:17:00,419 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_high_school_world_history.yaml' 2026-09-01T00:17:00,420 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_aging.yaml' 2026-09-01T00:17:00,421 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_human_sexuality.yaml' 2026-09-01T00:17:00,422 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_international_law.yaml' 2026-09-01T00:17:00,423 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_jurisprudence.yaml' 2026-09-01T00:17:00,424 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_logical_fallacies.yaml' 2026-09-01T00:17:00,425 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_machine_learning.yaml' 2026-09-01T00:17:00,426 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_management.yaml' 2026-09-01T00:17:00,428 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_marketing.yaml' 2026-09-01T00:17:00,429 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_medical_genetics.yaml' 2026-09-01T00:17:00,430 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_miscellaneous.yaml' 2026-09-01T00:17:00,431 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_disputes.yaml' 2026-09-01T00:17:00,432 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_moral_scenarios.yaml' 2026-09-01T00:17:00,433 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_nutrition.yaml' 2026-09-01T00:17:00,434 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_philosophy.yaml' 2026-09-01T00:17:00,436 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_prehistory.yaml' 2026-09-01T00:17:00,437 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_accounting.yaml' 2026-09-01T00:17:00,438 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_law.yaml' 2026-09-01T00:17:00,439 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_medicine.yaml' 2026-09-01T00:17:00,440 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_professional_psychology.yaml' 2026-09-01T00:17:00,441 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_public_relations.yaml' 2026-09-01T00:17:00,443 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_security_studies.yaml' 2026-09-01T00:17:00,444 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_sociology.yaml' 2026-09-01T00:17:00,445 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_us_foreign_policy.yaml' 2026-09-01T00:17:00,447 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_virology.yaml' 2026-09-01T00:17:00,448 adding 'lm_eval/tasks/global_mmlu/full/sn/global_mmlu_full_sn_world_religions.yaml' 2026-09-01T00:17:00,449 adding 'lm_eval/tasks/global_mmlu/full/sn/utils.py' 2026-09-01T00:17:00,453 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so.yaml' 2026-09-01T00:17:00,454 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_humanities.yaml' 2026-09-01T00:17:00,455 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_other.yaml' 2026-09-01T00:17:00,457 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_social_sciences.yaml' 2026-09-01T00:17:00,458 adding 'lm_eval/tasks/global_mmlu/full/so/_global_mmlu_full_so_stem.yaml' 2026-09-01T00:17:00,460 adding 'lm_eval/tasks/global_mmlu/full/so/_so_template_yaml' 2026-09-01T00:17:00,461 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_abstract_algebra.yaml' 2026-09-01T00:17:00,462 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_anatomy.yaml' 2026-09-01T00:17:00,463 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_astronomy.yaml' 2026-09-01T00:17:00,464 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_business_ethics.yaml' 2026-09-01T00:17:00,465 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_clinical_knowledge.yaml' 2026-09-01T00:17:00,466 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_biology.yaml' 2026-09-01T00:17:00,467 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_chemistry.yaml' 2026-09-01T00:17:00,468 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_computer_science.yaml' 2026-09-01T00:17:00,469 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_mathematics.yaml' 2026-09-01T00:17:00,471 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_medicine.yaml' 2026-09-01T00:17:00,472 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_college_physics.yaml' 2026-09-01T00:17:00,473 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_computer_security.yaml' 2026-09-01T00:17:00,474 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_conceptual_physics.yaml' 2026-09-01T00:17:00,475 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_econometrics.yaml' 2026-09-01T00:17:00,476 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_electrical_engineering.yaml' 2026-09-01T00:17:00,477 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_elementary_mathematics.yaml' 2026-09-01T00:17:00,479 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_formal_logic.yaml' 2026-09-01T00:17:00,480 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_global_facts.yaml' 2026-09-01T00:17:00,481 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_biology.yaml' 2026-09-01T00:17:00,482 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_chemistry.yaml' 2026-09-01T00:17:00,483 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_computer_science.yaml' 2026-09-01T00:17:00,484 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_european_history.yaml' 2026-09-01T00:17:00,485 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_geography.yaml' 2026-09-01T00:17:00,487 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,488 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,489 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_mathematics.yaml' 2026-09-01T00:17:00,491 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_microeconomics.yaml' 2026-09-01T00:17:00,492 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_physics.yaml' 2026-09-01T00:17:00,493 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_psychology.yaml' 2026-09-01T00:17:00,494 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_statistics.yaml' 2026-09-01T00:17:00,495 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_us_history.yaml' 2026-09-01T00:17:00,497 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_high_school_world_history.yaml' 2026-09-01T00:17:00,498 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_aging.yaml' 2026-09-01T00:17:00,499 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_human_sexuality.yaml' 2026-09-01T00:17:00,501 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_international_law.yaml' 2026-09-01T00:17:00,502 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_jurisprudence.yaml' 2026-09-01T00:17:00,503 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_logical_fallacies.yaml' 2026-09-01T00:17:00,504 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_machine_learning.yaml' 2026-09-01T00:17:00,505 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_management.yaml' 2026-09-01T00:17:00,506 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_marketing.yaml' 2026-09-01T00:17:00,508 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_medical_genetics.yaml' 2026-09-01T00:17:00,509 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_miscellaneous.yaml' 2026-09-01T00:17:00,510 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_disputes.yaml' 2026-09-01T00:17:00,511 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_moral_scenarios.yaml' 2026-09-01T00:17:00,512 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_nutrition.yaml' 2026-09-01T00:17:00,513 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_philosophy.yaml' 2026-09-01T00:17:00,514 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_prehistory.yaml' 2026-09-01T00:17:00,515 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_accounting.yaml' 2026-09-01T00:17:00,517 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_law.yaml' 2026-09-01T00:17:00,518 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_medicine.yaml' 2026-09-01T00:17:00,519 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_professional_psychology.yaml' 2026-09-01T00:17:00,520 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_public_relations.yaml' 2026-09-01T00:17:00,521 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_security_studies.yaml' 2026-09-01T00:17:00,522 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_sociology.yaml' 2026-09-01T00:17:00,523 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_us_foreign_policy.yaml' 2026-09-01T00:17:00,524 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_virology.yaml' 2026-09-01T00:17:00,526 adding 'lm_eval/tasks/global_mmlu/full/so/global_mmlu_full_so_world_religions.yaml' 2026-09-01T00:17:00,527 adding 'lm_eval/tasks/global_mmlu/full/so/utils.py' 2026-09-01T00:17:00,530 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr.yaml' 2026-09-01T00:17:00,531 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_humanities.yaml' 2026-09-01T00:17:00,532 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_other.yaml' 2026-09-01T00:17:00,533 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_social_sciences.yaml' 2026-09-01T00:17:00,534 adding 'lm_eval/tasks/global_mmlu/full/sr/_global_mmlu_full_sr_stem.yaml' 2026-09-01T00:17:00,536 adding 'lm_eval/tasks/global_mmlu/full/sr/_sr_template_yaml' 2026-09-01T00:17:00,537 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_abstract_algebra.yaml' 2026-09-01T00:17:00,538 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_anatomy.yaml' 2026-09-01T00:17:00,539 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_astronomy.yaml' 2026-09-01T00:17:00,541 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_business_ethics.yaml' 2026-09-01T00:17:00,542 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_clinical_knowledge.yaml' 2026-09-01T00:17:00,544 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_biology.yaml' 2026-09-01T00:17:00,545 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_chemistry.yaml' 2026-09-01T00:17:00,547 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_computer_science.yaml' 2026-09-01T00:17:00,548 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_mathematics.yaml' 2026-09-01T00:17:00,550 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_medicine.yaml' 2026-09-01T00:17:00,552 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_college_physics.yaml' 2026-09-01T00:17:00,553 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_computer_security.yaml' 2026-09-01T00:17:00,554 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_conceptual_physics.yaml' 2026-09-01T00:17:00,555 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_econometrics.yaml' 2026-09-01T00:17:00,556 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_electrical_engineering.yaml' 2026-09-01T00:17:00,557 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_elementary_mathematics.yaml' 2026-09-01T00:17:00,558 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_formal_logic.yaml' 2026-09-01T00:17:00,560 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_global_facts.yaml' 2026-09-01T00:17:00,561 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_biology.yaml' 2026-09-01T00:17:00,562 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_chemistry.yaml' 2026-09-01T00:17:00,563 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_computer_science.yaml' 2026-09-01T00:17:00,564 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_european_history.yaml' 2026-09-01T00:17:00,565 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_geography.yaml' 2026-09-01T00:17:00,567 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,568 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,569 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_mathematics.yaml' 2026-09-01T00:17:00,570 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_microeconomics.yaml' 2026-09-01T00:17:00,571 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_physics.yaml' 2026-09-01T00:17:00,573 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_psychology.yaml' 2026-09-01T00:17:00,574 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_statistics.yaml' 2026-09-01T00:17:00,575 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_us_history.yaml' 2026-09-01T00:17:00,576 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_high_school_world_history.yaml' 2026-09-01T00:17:00,577 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_aging.yaml' 2026-09-01T00:17:00,579 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_human_sexuality.yaml' 2026-09-01T00:17:00,580 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_international_law.yaml' 2026-09-01T00:17:00,581 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_jurisprudence.yaml' 2026-09-01T00:17:00,582 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_logical_fallacies.yaml' 2026-09-01T00:17:00,584 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_machine_learning.yaml' 2026-09-01T00:17:00,585 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_management.yaml' 2026-09-01T00:17:00,586 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_marketing.yaml' 2026-09-01T00:17:00,587 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_medical_genetics.yaml' 2026-09-01T00:17:00,588 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_miscellaneous.yaml' 2026-09-01T00:17:00,590 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_disputes.yaml' 2026-09-01T00:17:00,591 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_moral_scenarios.yaml' 2026-09-01T00:17:00,592 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_nutrition.yaml' 2026-09-01T00:17:00,593 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_philosophy.yaml' 2026-09-01T00:17:00,594 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_prehistory.yaml' 2026-09-01T00:17:00,596 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_accounting.yaml' 2026-09-01T00:17:00,597 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_law.yaml' 2026-09-01T00:17:00,598 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_medicine.yaml' 2026-09-01T00:17:00,599 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_professional_psychology.yaml' 2026-09-01T00:17:00,600 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_public_relations.yaml' 2026-09-01T00:17:00,601 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_security_studies.yaml' 2026-09-01T00:17:00,602 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_sociology.yaml' 2026-09-01T00:17:00,603 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_us_foreign_policy.yaml' 2026-09-01T00:17:00,604 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_virology.yaml' 2026-09-01T00:17:00,605 adding 'lm_eval/tasks/global_mmlu/full/sr/global_mmlu_full_sr_world_religions.yaml' 2026-09-01T00:17:00,607 adding 'lm_eval/tasks/global_mmlu/full/sr/utils.py' 2026-09-01T00:17:00,610 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv.yaml' 2026-09-01T00:17:00,611 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_humanities.yaml' 2026-09-01T00:17:00,612 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_other.yaml' 2026-09-01T00:17:00,613 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_social_sciences.yaml' 2026-09-01T00:17:00,614 adding 'lm_eval/tasks/global_mmlu/full/sv/_global_mmlu_full_sv_stem.yaml' 2026-09-01T00:17:00,616 adding 'lm_eval/tasks/global_mmlu/full/sv/_sv_template_yaml' 2026-09-01T00:17:00,617 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_abstract_algebra.yaml' 2026-09-01T00:17:00,618 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_anatomy.yaml' 2026-09-01T00:17:00,619 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_astronomy.yaml' 2026-09-01T00:17:00,620 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_business_ethics.yaml' 2026-09-01T00:17:00,622 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_clinical_knowledge.yaml' 2026-09-01T00:17:00,623 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_biology.yaml' 2026-09-01T00:17:00,624 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_chemistry.yaml' 2026-09-01T00:17:00,625 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_computer_science.yaml' 2026-09-01T00:17:00,626 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_mathematics.yaml' 2026-09-01T00:17:00,628 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_medicine.yaml' 2026-09-01T00:17:00,629 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_college_physics.yaml' 2026-09-01T00:17:00,630 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_computer_security.yaml' 2026-09-01T00:17:00,631 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_conceptual_physics.yaml' 2026-09-01T00:17:00,633 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_econometrics.yaml' 2026-09-01T00:17:00,634 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_electrical_engineering.yaml' 2026-09-01T00:17:00,635 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_elementary_mathematics.yaml' 2026-09-01T00:17:00,636 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_formal_logic.yaml' 2026-09-01T00:17:00,638 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_global_facts.yaml' 2026-09-01T00:17:00,639 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_biology.yaml' 2026-09-01T00:17:00,640 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_chemistry.yaml' 2026-09-01T00:17:00,641 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_computer_science.yaml' 2026-09-01T00:17:00,642 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_european_history.yaml' 2026-09-01T00:17:00,644 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_geography.yaml' 2026-09-01T00:17:00,645 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,646 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,647 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_mathematics.yaml' 2026-09-01T00:17:00,648 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_microeconomics.yaml' 2026-09-01T00:17:00,649 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_physics.yaml' 2026-09-01T00:17:00,651 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_psychology.yaml' 2026-09-01T00:17:00,652 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_statistics.yaml' 2026-09-01T00:17:00,653 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_us_history.yaml' 2026-09-01T00:17:00,654 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_high_school_world_history.yaml' 2026-09-01T00:17:00,655 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_aging.yaml' 2026-09-01T00:17:00,656 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_human_sexuality.yaml' 2026-09-01T00:17:00,658 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_international_law.yaml' 2026-09-01T00:17:00,659 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_jurisprudence.yaml' 2026-09-01T00:17:00,660 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_logical_fallacies.yaml' 2026-09-01T00:17:00,661 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_machine_learning.yaml' 2026-09-01T00:17:00,662 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_management.yaml' 2026-09-01T00:17:00,663 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_marketing.yaml' 2026-09-01T00:17:00,665 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_medical_genetics.yaml' 2026-09-01T00:17:00,666 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_miscellaneous.yaml' 2026-09-01T00:17:00,667 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_disputes.yaml' 2026-09-01T00:17:00,668 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_moral_scenarios.yaml' 2026-09-01T00:17:00,669 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_nutrition.yaml' 2026-09-01T00:17:00,670 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_philosophy.yaml' 2026-09-01T00:17:00,671 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_prehistory.yaml' 2026-09-01T00:17:00,673 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_accounting.yaml' 2026-09-01T00:17:00,674 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_law.yaml' 2026-09-01T00:17:00,675 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_medicine.yaml' 2026-09-01T00:17:00,676 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_professional_psychology.yaml' 2026-09-01T00:17:00,677 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_public_relations.yaml' 2026-09-01T00:17:00,678 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_security_studies.yaml' 2026-09-01T00:17:00,680 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_sociology.yaml' 2026-09-01T00:17:00,681 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_us_foreign_policy.yaml' 2026-09-01T00:17:00,682 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_virology.yaml' 2026-09-01T00:17:00,683 adding 'lm_eval/tasks/global_mmlu/full/sv/global_mmlu_full_sv_world_religions.yaml' 2026-09-01T00:17:00,684 adding 'lm_eval/tasks/global_mmlu/full/sv/utils.py' 2026-09-01T00:17:00,687 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw.yaml' 2026-09-01T00:17:00,688 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_humanities.yaml' 2026-09-01T00:17:00,689 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_other.yaml' 2026-09-01T00:17:00,691 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_social_sciences.yaml' 2026-09-01T00:17:00,692 adding 'lm_eval/tasks/global_mmlu/full/sw/_global_mmlu_full_sw_stem.yaml' 2026-09-01T00:17:00,693 adding 'lm_eval/tasks/global_mmlu/full/sw/_sw_template_yaml' 2026-09-01T00:17:00,694 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_abstract_algebra.yaml' 2026-09-01T00:17:00,695 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_anatomy.yaml' 2026-09-01T00:17:00,696 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_astronomy.yaml' 2026-09-01T00:17:00,697 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_business_ethics.yaml' 2026-09-01T00:17:00,698 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_clinical_knowledge.yaml' 2026-09-01T00:17:00,700 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_biology.yaml' 2026-09-01T00:17:00,701 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_chemistry.yaml' 2026-09-01T00:17:00,702 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_computer_science.yaml' 2026-09-01T00:17:00,703 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_mathematics.yaml' 2026-09-01T00:17:00,704 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_medicine.yaml' 2026-09-01T00:17:00,705 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_college_physics.yaml' 2026-09-01T00:17:00,706 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_computer_security.yaml' 2026-09-01T00:17:00,708 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_conceptual_physics.yaml' 2026-09-01T00:17:00,709 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_econometrics.yaml' 2026-09-01T00:17:00,710 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_electrical_engineering.yaml' 2026-09-01T00:17:00,711 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_elementary_mathematics.yaml' 2026-09-01T00:17:00,712 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_formal_logic.yaml' 2026-09-01T00:17:00,713 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_global_facts.yaml' 2026-09-01T00:17:00,715 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_biology.yaml' 2026-09-01T00:17:00,716 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_chemistry.yaml' 2026-09-01T00:17:00,717 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_computer_science.yaml' 2026-09-01T00:17:00,718 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_european_history.yaml' 2026-09-01T00:17:00,719 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_geography.yaml' 2026-09-01T00:17:00,720 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,722 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,723 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_mathematics.yaml' 2026-09-01T00:17:00,724 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_microeconomics.yaml' 2026-09-01T00:17:00,725 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_physics.yaml' 2026-09-01T00:17:00,726 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_psychology.yaml' 2026-09-01T00:17:00,728 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_statistics.yaml' 2026-09-01T00:17:00,729 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_us_history.yaml' 2026-09-01T00:17:00,730 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_high_school_world_history.yaml' 2026-09-01T00:17:00,731 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_aging.yaml' 2026-09-01T00:17:00,732 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_human_sexuality.yaml' 2026-09-01T00:17:00,733 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_international_law.yaml' 2026-09-01T00:17:00,734 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_jurisprudence.yaml' 2026-09-01T00:17:00,735 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_logical_fallacies.yaml' 2026-09-01T00:17:00,736 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_machine_learning.yaml' 2026-09-01T00:17:00,737 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_management.yaml' 2026-09-01T00:17:00,739 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_marketing.yaml' 2026-09-01T00:17:00,740 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_medical_genetics.yaml' 2026-09-01T00:17:00,741 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_miscellaneous.yaml' 2026-09-01T00:17:00,742 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_disputes.yaml' 2026-09-01T00:17:00,743 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_moral_scenarios.yaml' 2026-09-01T00:17:00,744 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_nutrition.yaml' 2026-09-01T00:17:00,745 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_philosophy.yaml' 2026-09-01T00:17:00,747 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_prehistory.yaml' 2026-09-01T00:17:00,748 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_accounting.yaml' 2026-09-01T00:17:00,749 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_law.yaml' 2026-09-01T00:17:00,750 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_medicine.yaml' 2026-09-01T00:17:00,751 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_professional_psychology.yaml' 2026-09-01T00:17:00,752 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_public_relations.yaml' 2026-09-01T00:17:00,753 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_security_studies.yaml' 2026-09-01T00:17:00,755 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_sociology.yaml' 2026-09-01T00:17:00,756 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_us_foreign_policy.yaml' 2026-09-01T00:17:00,757 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_virology.yaml' 2026-09-01T00:17:00,758 adding 'lm_eval/tasks/global_mmlu/full/sw/global_mmlu_full_sw_world_religions.yaml' 2026-09-01T00:17:00,759 adding 'lm_eval/tasks/global_mmlu/full/sw/utils.py' 2026-09-01T00:17:00,762 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te.yaml' 2026-09-01T00:17:00,763 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_humanities.yaml' 2026-09-01T00:17:00,764 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_other.yaml' 2026-09-01T00:17:00,766 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_social_sciences.yaml' 2026-09-01T00:17:00,767 adding 'lm_eval/tasks/global_mmlu/full/te/_global_mmlu_full_te_stem.yaml' 2026-09-01T00:17:00,768 adding 'lm_eval/tasks/global_mmlu/full/te/_te_template_yaml' 2026-09-01T00:17:00,769 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_abstract_algebra.yaml' 2026-09-01T00:17:00,770 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_anatomy.yaml' 2026-09-01T00:17:00,771 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_astronomy.yaml' 2026-09-01T00:17:00,773 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_business_ethics.yaml' 2026-09-01T00:17:00,774 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_clinical_knowledge.yaml' 2026-09-01T00:17:00,775 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_biology.yaml' 2026-09-01T00:17:00,776 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_chemistry.yaml' 2026-09-01T00:17:00,777 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_computer_science.yaml' 2026-09-01T00:17:00,778 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_mathematics.yaml' 2026-09-01T00:17:00,779 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_medicine.yaml' 2026-09-01T00:17:00,780 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_college_physics.yaml' 2026-09-01T00:17:00,782 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_computer_security.yaml' 2026-09-01T00:17:00,783 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_conceptual_physics.yaml' 2026-09-01T00:17:00,784 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_econometrics.yaml' 2026-09-01T00:17:00,785 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_electrical_engineering.yaml' 2026-09-01T00:17:00,786 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_elementary_mathematics.yaml' 2026-09-01T00:17:00,787 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_formal_logic.yaml' 2026-09-01T00:17:00,788 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_global_facts.yaml' 2026-09-01T00:17:00,789 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_biology.yaml' 2026-09-01T00:17:00,791 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_chemistry.yaml' 2026-09-01T00:17:00,792 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_computer_science.yaml' 2026-09-01T00:17:00,793 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_european_history.yaml' 2026-09-01T00:17:00,794 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_geography.yaml' 2026-09-01T00:17:00,795 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,796 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,798 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_mathematics.yaml' 2026-09-01T00:17:00,799 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_microeconomics.yaml' 2026-09-01T00:17:00,800 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_physics.yaml' 2026-09-01T00:17:00,801 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_psychology.yaml' 2026-09-01T00:17:00,802 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_statistics.yaml' 2026-09-01T00:17:00,803 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_us_history.yaml' 2026-09-01T00:17:00,804 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_high_school_world_history.yaml' 2026-09-01T00:17:00,806 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_aging.yaml' 2026-09-01T00:17:00,807 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_human_sexuality.yaml' 2026-09-01T00:17:00,808 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_international_law.yaml' 2026-09-01T00:17:00,809 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_jurisprudence.yaml' 2026-09-01T00:17:00,810 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_logical_fallacies.yaml' 2026-09-01T00:17:00,812 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_machine_learning.yaml' 2026-09-01T00:17:00,813 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_management.yaml' 2026-09-01T00:17:00,814 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_marketing.yaml' 2026-09-01T00:17:00,815 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_medical_genetics.yaml' 2026-09-01T00:17:00,816 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_miscellaneous.yaml' 2026-09-01T00:17:00,817 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_disputes.yaml' 2026-09-01T00:17:00,818 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_moral_scenarios.yaml' 2026-09-01T00:17:00,819 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_nutrition.yaml' 2026-09-01T00:17:00,820 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_philosophy.yaml' 2026-09-01T00:17:00,821 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_prehistory.yaml' 2026-09-01T00:17:00,823 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_accounting.yaml' 2026-09-01T00:17:00,824 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_law.yaml' 2026-09-01T00:17:00,825 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_medicine.yaml' 2026-09-01T00:17:00,826 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_professional_psychology.yaml' 2026-09-01T00:17:00,827 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_public_relations.yaml' 2026-09-01T00:17:00,828 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_security_studies.yaml' 2026-09-01T00:17:00,829 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_sociology.yaml' 2026-09-01T00:17:00,830 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_us_foreign_policy.yaml' 2026-09-01T00:17:00,831 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_virology.yaml' 2026-09-01T00:17:00,832 adding 'lm_eval/tasks/global_mmlu/full/te/global_mmlu_full_te_world_religions.yaml' 2026-09-01T00:17:00,834 adding 'lm_eval/tasks/global_mmlu/full/te/utils.py' 2026-09-01T00:17:00,837 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr.yaml' 2026-09-01T00:17:00,838 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_humanities.yaml' 2026-09-01T00:17:00,839 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_other.yaml' 2026-09-01T00:17:00,840 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_social_sciences.yaml' 2026-09-01T00:17:00,841 adding 'lm_eval/tasks/global_mmlu/full/tr/_global_mmlu_full_tr_stem.yaml' 2026-09-01T00:17:00,843 adding 'lm_eval/tasks/global_mmlu/full/tr/_tr_template_yaml' 2026-09-01T00:17:00,844 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_abstract_algebra.yaml' 2026-09-01T00:17:00,845 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_anatomy.yaml' 2026-09-01T00:17:00,846 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_astronomy.yaml' 2026-09-01T00:17:00,847 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_business_ethics.yaml' 2026-09-01T00:17:00,849 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_clinical_knowledge.yaml' 2026-09-01T00:17:00,850 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_biology.yaml' 2026-09-01T00:17:00,851 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_chemistry.yaml' 2026-09-01T00:17:00,852 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_computer_science.yaml' 2026-09-01T00:17:00,853 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_mathematics.yaml' 2026-09-01T00:17:00,854 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_medicine.yaml' 2026-09-01T00:17:00,855 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_college_physics.yaml' 2026-09-01T00:17:00,857 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_computer_security.yaml' 2026-09-01T00:17:00,858 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_conceptual_physics.yaml' 2026-09-01T00:17:00,859 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_econometrics.yaml' 2026-09-01T00:17:00,860 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_electrical_engineering.yaml' 2026-09-01T00:17:00,861 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_elementary_mathematics.yaml' 2026-09-01T00:17:00,862 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_formal_logic.yaml' 2026-09-01T00:17:00,863 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_global_facts.yaml' 2026-09-01T00:17:00,864 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_biology.yaml' 2026-09-01T00:17:00,865 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_chemistry.yaml' 2026-09-01T00:17:00,866 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_computer_science.yaml' 2026-09-01T00:17:00,868 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_european_history.yaml' 2026-09-01T00:17:00,869 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_geography.yaml' 2026-09-01T00:17:00,870 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,871 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,872 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_mathematics.yaml' 2026-09-01T00:17:00,873 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_microeconomics.yaml' 2026-09-01T00:17:00,874 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_physics.yaml' 2026-09-01T00:17:00,875 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_psychology.yaml' 2026-09-01T00:17:00,877 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_statistics.yaml' 2026-09-01T00:17:00,878 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_us_history.yaml' 2026-09-01T00:17:00,879 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_high_school_world_history.yaml' 2026-09-01T00:17:00,880 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_aging.yaml' 2026-09-01T00:17:00,881 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_human_sexuality.yaml' 2026-09-01T00:17:00,882 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_international_law.yaml' 2026-09-01T00:17:00,884 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_jurisprudence.yaml' 2026-09-01T00:17:00,885 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_logical_fallacies.yaml' 2026-09-01T00:17:00,886 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_machine_learning.yaml' 2026-09-01T00:17:00,887 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_management.yaml' 2026-09-01T00:17:00,888 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_marketing.yaml' 2026-09-01T00:17:00,890 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_medical_genetics.yaml' 2026-09-01T00:17:00,891 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_miscellaneous.yaml' 2026-09-01T00:17:00,892 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_disputes.yaml' 2026-09-01T00:17:00,893 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_moral_scenarios.yaml' 2026-09-01T00:17:00,894 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_nutrition.yaml' 2026-09-01T00:17:00,895 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_philosophy.yaml' 2026-09-01T00:17:00,897 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_prehistory.yaml' 2026-09-01T00:17:00,898 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_accounting.yaml' 2026-09-01T00:17:00,899 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_law.yaml' 2026-09-01T00:17:00,900 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_medicine.yaml' 2026-09-01T00:17:00,901 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_professional_psychology.yaml' 2026-09-01T00:17:00,902 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_public_relations.yaml' 2026-09-01T00:17:00,903 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_security_studies.yaml' 2026-09-01T00:17:00,904 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_sociology.yaml' 2026-09-01T00:17:00,905 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_us_foreign_policy.yaml' 2026-09-01T00:17:00,907 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_virology.yaml' 2026-09-01T00:17:00,908 adding 'lm_eval/tasks/global_mmlu/full/tr/global_mmlu_full_tr_world_religions.yaml' 2026-09-01T00:17:00,909 adding 'lm_eval/tasks/global_mmlu/full/tr/utils.py' 2026-09-01T00:17:00,912 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk.yaml' 2026-09-01T00:17:00,913 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_humanities.yaml' 2026-09-01T00:17:00,914 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_other.yaml' 2026-09-01T00:17:00,915 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_social_sciences.yaml' 2026-09-01T00:17:00,916 adding 'lm_eval/tasks/global_mmlu/full/uk/_global_mmlu_full_uk_stem.yaml' 2026-09-01T00:17:00,918 adding 'lm_eval/tasks/global_mmlu/full/uk/_uk_template_yaml' 2026-09-01T00:17:00,919 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_abstract_algebra.yaml' 2026-09-01T00:17:00,920 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_anatomy.yaml' 2026-09-01T00:17:00,921 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_astronomy.yaml' 2026-09-01T00:17:00,922 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_business_ethics.yaml' 2026-09-01T00:17:00,923 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_clinical_knowledge.yaml' 2026-09-01T00:17:00,924 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_biology.yaml' 2026-09-01T00:17:00,925 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_chemistry.yaml' 2026-09-01T00:17:00,927 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_computer_science.yaml' 2026-09-01T00:17:00,928 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_mathematics.yaml' 2026-09-01T00:17:00,929 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_medicine.yaml' 2026-09-01T00:17:00,930 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_college_physics.yaml' 2026-09-01T00:17:00,932 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_computer_security.yaml' 2026-09-01T00:17:00,933 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_conceptual_physics.yaml' 2026-09-01T00:17:00,935 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_econometrics.yaml' 2026-09-01T00:17:00,936 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_electrical_engineering.yaml' 2026-09-01T00:17:00,937 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_elementary_mathematics.yaml' 2026-09-01T00:17:00,938 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_formal_logic.yaml' 2026-09-01T00:17:00,939 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_global_facts.yaml' 2026-09-01T00:17:00,941 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_biology.yaml' 2026-09-01T00:17:00,942 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_chemistry.yaml' 2026-09-01T00:17:00,943 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_computer_science.yaml' 2026-09-01T00:17:00,944 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_european_history.yaml' 2026-09-01T00:17:00,945 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_geography.yaml' 2026-09-01T00:17:00,947 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_government_and_politics.yaml' 2026-09-01T00:17:00,948 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_macroeconomics.yaml' 2026-09-01T00:17:00,949 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_mathematics.yaml' 2026-09-01T00:17:00,950 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_microeconomics.yaml' 2026-09-01T00:17:00,951 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_physics.yaml' 2026-09-01T00:17:00,952 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_psychology.yaml' 2026-09-01T00:17:00,953 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_statistics.yaml' 2026-09-01T00:17:00,954 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_us_history.yaml' 2026-09-01T00:17:00,955 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_high_school_world_history.yaml' 2026-09-01T00:17:00,957 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_aging.yaml' 2026-09-01T00:17:00,958 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_human_sexuality.yaml' 2026-09-01T00:17:00,959 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_international_law.yaml' 2026-09-01T00:17:00,960 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_jurisprudence.yaml' 2026-09-01T00:17:00,961 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_logical_fallacies.yaml' 2026-09-01T00:17:00,962 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_machine_learning.yaml' 2026-09-01T00:17:00,963 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_management.yaml' 2026-09-01T00:17:00,964 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_marketing.yaml' 2026-09-01T00:17:00,966 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_medical_genetics.yaml' 2026-09-01T00:17:00,967 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_miscellaneous.yaml' 2026-09-01T00:17:00,968 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_disputes.yaml' 2026-09-01T00:17:00,969 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_moral_scenarios.yaml' 2026-09-01T00:17:00,970 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_nutrition.yaml' 2026-09-01T00:17:00,971 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_philosophy.yaml' 2026-09-01T00:17:00,973 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_prehistory.yaml' 2026-09-01T00:17:00,974 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_accounting.yaml' 2026-09-01T00:17:00,975 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_law.yaml' 2026-09-01T00:17:00,976 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_medicine.yaml' 2026-09-01T00:17:00,977 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_professional_psychology.yaml' 2026-09-01T00:17:00,978 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_public_relations.yaml' 2026-09-01T00:17:00,980 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_security_studies.yaml' 2026-09-01T00:17:00,981 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_sociology.yaml' 2026-09-01T00:17:00,982 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_us_foreign_policy.yaml' 2026-09-01T00:17:00,983 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_virology.yaml' 2026-09-01T00:17:00,984 adding 'lm_eval/tasks/global_mmlu/full/uk/global_mmlu_full_uk_world_religions.yaml' 2026-09-01T00:17:00,986 adding 'lm_eval/tasks/global_mmlu/full/uk/utils.py' 2026-09-01T00:17:00,989 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi.yaml' 2026-09-01T00:17:00,990 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_humanities.yaml' 2026-09-01T00:17:00,991 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_other.yaml' 2026-09-01T00:17:00,992 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_social_sciences.yaml' 2026-09-01T00:17:00,993 adding 'lm_eval/tasks/global_mmlu/full/vi/_global_mmlu_full_vi_stem.yaml' 2026-09-01T00:17:00,994 adding 'lm_eval/tasks/global_mmlu/full/vi/_vi_template_yaml' 2026-09-01T00:17:00,996 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_abstract_algebra.yaml' 2026-09-01T00:17:00,997 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_anatomy.yaml' 2026-09-01T00:17:00,998 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_astronomy.yaml' 2026-09-01T00:17:00,999 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_business_ethics.yaml' 2026-09-01T00:17:01,000 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_clinical_knowledge.yaml' 2026-09-01T00:17:01,001 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_biology.yaml' 2026-09-01T00:17:01,002 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_chemistry.yaml' 2026-09-01T00:17:01,004 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_computer_science.yaml' 2026-09-01T00:17:01,005 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_mathematics.yaml' 2026-09-01T00:17:01,006 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_medicine.yaml' 2026-09-01T00:17:01,007 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_college_physics.yaml' 2026-09-01T00:17:01,008 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_computer_security.yaml' 2026-09-01T00:17:01,009 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_conceptual_physics.yaml' 2026-09-01T00:17:01,010 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_econometrics.yaml' 2026-09-01T00:17:01,011 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_electrical_engineering.yaml' 2026-09-01T00:17:01,013 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_elementary_mathematics.yaml' 2026-09-01T00:17:01,014 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_formal_logic.yaml' 2026-09-01T00:17:01,015 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_global_facts.yaml' 2026-09-01T00:17:01,016 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_biology.yaml' 2026-09-01T00:17:01,017 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_chemistry.yaml' 2026-09-01T00:17:01,018 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_computer_science.yaml' 2026-09-01T00:17:01,019 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_european_history.yaml' 2026-09-01T00:17:01,021 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_geography.yaml' 2026-09-01T00:17:01,022 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_government_and_politics.yaml' 2026-09-01T00:17:01,023 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_macroeconomics.yaml' 2026-09-01T00:17:01,024 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_mathematics.yaml' 2026-09-01T00:17:01,025 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_microeconomics.yaml' 2026-09-01T00:17:01,026 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_physics.yaml' 2026-09-01T00:17:01,027 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_psychology.yaml' 2026-09-01T00:17:01,029 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_statistics.yaml' 2026-09-01T00:17:01,030 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_us_history.yaml' 2026-09-01T00:17:01,031 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_high_school_world_history.yaml' 2026-09-01T00:17:01,032 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_aging.yaml' 2026-09-01T00:17:01,033 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_human_sexuality.yaml' 2026-09-01T00:17:01,034 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_international_law.yaml' 2026-09-01T00:17:01,035 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_jurisprudence.yaml' 2026-09-01T00:17:01,036 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_logical_fallacies.yaml' 2026-09-01T00:17:01,037 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_machine_learning.yaml' 2026-09-01T00:17:01,038 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_management.yaml' 2026-09-01T00:17:01,039 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_marketing.yaml' 2026-09-01T00:17:01,040 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_medical_genetics.yaml' 2026-09-01T00:17:01,042 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_miscellaneous.yaml' 2026-09-01T00:17:01,043 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_disputes.yaml' 2026-09-01T00:17:01,044 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_moral_scenarios.yaml' 2026-09-01T00:17:01,045 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_nutrition.yaml' 2026-09-01T00:17:01,046 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_philosophy.yaml' 2026-09-01T00:17:01,047 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_prehistory.yaml' 2026-09-01T00:17:01,048 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_accounting.yaml' 2026-09-01T00:17:01,049 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_law.yaml' 2026-09-01T00:17:01,050 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_medicine.yaml' 2026-09-01T00:17:01,051 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_professional_psychology.yaml' 2026-09-01T00:17:01,053 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_public_relations.yaml' 2026-09-01T00:17:01,054 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_security_studies.yaml' 2026-09-01T00:17:01,055 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_sociology.yaml' 2026-09-01T00:17:01,056 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_us_foreign_policy.yaml' 2026-09-01T00:17:01,057 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_virology.yaml' 2026-09-01T00:17:01,058 adding 'lm_eval/tasks/global_mmlu/full/vi/global_mmlu_full_vi_world_religions.yaml' 2026-09-01T00:17:01,060 adding 'lm_eval/tasks/global_mmlu/full/vi/utils.py' 2026-09-01T00:17:01,062 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo.yaml' 2026-09-01T00:17:01,064 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_humanities.yaml' 2026-09-01T00:17:01,065 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_other.yaml' 2026-09-01T00:17:01,066 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_social_sciences.yaml' 2026-09-01T00:17:01,067 adding 'lm_eval/tasks/global_mmlu/full/yo/_global_mmlu_full_yo_stem.yaml' 2026-09-01T00:17:01,068 adding 'lm_eval/tasks/global_mmlu/full/yo/_yo_template_yaml' 2026-09-01T00:17:01,069 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_abstract_algebra.yaml' 2026-09-01T00:17:01,071 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_anatomy.yaml' 2026-09-01T00:17:01,072 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_astronomy.yaml' 2026-09-01T00:17:01,073 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_business_ethics.yaml' 2026-09-01T00:17:01,074 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_clinical_knowledge.yaml' 2026-09-01T00:17:01,075 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_biology.yaml' 2026-09-01T00:17:01,076 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_chemistry.yaml' 2026-09-01T00:17:01,077 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_computer_science.yaml' 2026-09-01T00:17:01,078 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_mathematics.yaml' 2026-09-01T00:17:01,080 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_medicine.yaml' 2026-09-01T00:17:01,081 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_college_physics.yaml' 2026-09-01T00:17:01,082 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_computer_security.yaml' 2026-09-01T00:17:01,083 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_conceptual_physics.yaml' 2026-09-01T00:17:01,084 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_econometrics.yaml' 2026-09-01T00:17:01,085 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_electrical_engineering.yaml' 2026-09-01T00:17:01,086 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_elementary_mathematics.yaml' 2026-09-01T00:17:01,087 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_formal_logic.yaml' 2026-09-01T00:17:01,089 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_global_facts.yaml' 2026-09-01T00:17:01,090 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_biology.yaml' 2026-09-01T00:17:01,091 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_chemistry.yaml' 2026-09-01T00:17:01,092 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_computer_science.yaml' 2026-09-01T00:17:01,093 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_european_history.yaml' 2026-09-01T00:17:01,094 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_geography.yaml' 2026-09-01T00:17:01,095 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_government_and_politics.yaml' 2026-09-01T00:17:01,097 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_macroeconomics.yaml' 2026-09-01T00:17:01,098 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_mathematics.yaml' 2026-09-01T00:17:01,099 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_microeconomics.yaml' 2026-09-01T00:17:01,100 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_physics.yaml' 2026-09-01T00:17:01,101 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_psychology.yaml' 2026-09-01T00:17:01,102 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_statistics.yaml' 2026-09-01T00:17:01,104 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_us_history.yaml' 2026-09-01T00:17:01,105 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_high_school_world_history.yaml' 2026-09-01T00:17:01,106 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_aging.yaml' 2026-09-01T00:17:01,107 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_human_sexuality.yaml' 2026-09-01T00:17:01,108 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_international_law.yaml' 2026-09-01T00:17:01,109 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_jurisprudence.yaml' 2026-09-01T00:17:01,111 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_logical_fallacies.yaml' 2026-09-01T00:17:01,112 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_machine_learning.yaml' 2026-09-01T00:17:01,113 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_management.yaml' 2026-09-01T00:17:01,114 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_marketing.yaml' 2026-09-01T00:17:01,115 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_medical_genetics.yaml' 2026-09-01T00:17:01,116 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_miscellaneous.yaml' 2026-09-01T00:17:01,118 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_disputes.yaml' 2026-09-01T00:17:01,119 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_moral_scenarios.yaml' 2026-09-01T00:17:01,120 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_nutrition.yaml' 2026-09-01T00:17:01,121 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_philosophy.yaml' 2026-09-01T00:17:01,122 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_prehistory.yaml' 2026-09-01T00:17:01,123 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_accounting.yaml' 2026-09-01T00:17:01,124 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_law.yaml' 2026-09-01T00:17:01,125 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_medicine.yaml' 2026-09-01T00:17:01,126 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_professional_psychology.yaml' 2026-09-01T00:17:01,127 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_public_relations.yaml' 2026-09-01T00:17:01,128 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_security_studies.yaml' 2026-09-01T00:17:01,129 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_sociology.yaml' 2026-09-01T00:17:01,130 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_us_foreign_policy.yaml' 2026-09-01T00:17:01,131 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_virology.yaml' 2026-09-01T00:17:01,132 adding 'lm_eval/tasks/global_mmlu/full/yo/global_mmlu_full_yo_world_religions.yaml' 2026-09-01T00:17:01,134 adding 'lm_eval/tasks/global_mmlu/full/yo/utils.py' 2026-09-01T00:17:01,137 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh.yaml' 2026-09-01T00:17:01,138 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_humanities.yaml' 2026-09-01T00:17:01,139 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_other.yaml' 2026-09-01T00:17:01,140 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_social_sciences.yaml' 2026-09-01T00:17:01,141 adding 'lm_eval/tasks/global_mmlu/full/zh/_global_mmlu_full_zh_stem.yaml' 2026-09-01T00:17:01,142 adding 'lm_eval/tasks/global_mmlu/full/zh/_zh_template_yaml' 2026-09-01T00:17:01,144 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_abstract_algebra.yaml' 2026-09-01T00:17:01,145 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_anatomy.yaml' 2026-09-01T00:17:01,146 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_astronomy.yaml' 2026-09-01T00:17:01,147 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_business_ethics.yaml' 2026-09-01T00:17:01,148 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_clinical_knowledge.yaml' 2026-09-01T00:17:01,149 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_biology.yaml' 2026-09-01T00:17:01,150 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_chemistry.yaml' 2026-09-01T00:17:01,152 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_computer_science.yaml' 2026-09-01T00:17:01,153 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_mathematics.yaml' 2026-09-01T00:17:01,154 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_medicine.yaml' 2026-09-01T00:17:01,155 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_college_physics.yaml' 2026-09-01T00:17:01,156 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_computer_security.yaml' 2026-09-01T00:17:01,158 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_conceptual_physics.yaml' 2026-09-01T00:17:01,159 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_econometrics.yaml' 2026-09-01T00:17:01,160 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_electrical_engineering.yaml' 2026-09-01T00:17:01,161 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_elementary_mathematics.yaml' 2026-09-01T00:17:01,162 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_formal_logic.yaml' 2026-09-01T00:17:01,163 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_global_facts.yaml' 2026-09-01T00:17:01,164 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_biology.yaml' 2026-09-01T00:17:01,166 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_chemistry.yaml' 2026-09-01T00:17:01,167 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_computer_science.yaml' 2026-09-01T00:17:01,168 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_european_history.yaml' 2026-09-01T00:17:01,169 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_geography.yaml' 2026-09-01T00:17:01,170 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_government_and_politics.yaml' 2026-09-01T00:17:01,171 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_macroeconomics.yaml' 2026-09-01T00:17:01,172 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_mathematics.yaml' 2026-09-01T00:17:01,173 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_microeconomics.yaml' 2026-09-01T00:17:01,174 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_physics.yaml' 2026-09-01T00:17:01,176 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_psychology.yaml' 2026-09-01T00:17:01,177 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_statistics.yaml' 2026-09-01T00:17:01,178 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_us_history.yaml' 2026-09-01T00:17:01,179 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_high_school_world_history.yaml' 2026-09-01T00:17:01,180 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_aging.yaml' 2026-09-01T00:17:01,181 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_human_sexuality.yaml' 2026-09-01T00:17:01,182 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_international_law.yaml' 2026-09-01T00:17:01,183 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_jurisprudence.yaml' 2026-09-01T00:17:01,184 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_logical_fallacies.yaml' 2026-09-01T00:17:01,186 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_machine_learning.yaml' 2026-09-01T00:17:01,187 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_management.yaml' 2026-09-01T00:17:01,188 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_marketing.yaml' 2026-09-01T00:17:01,189 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_medical_genetics.yaml' 2026-09-01T00:17:01,190 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_miscellaneous.yaml' 2026-09-01T00:17:01,191 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_disputes.yaml' 2026-09-01T00:17:01,192 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_moral_scenarios.yaml' 2026-09-01T00:17:01,194 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_nutrition.yaml' 2026-09-01T00:17:01,195 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_philosophy.yaml' 2026-09-01T00:17:01,196 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_prehistory.yaml' 2026-09-01T00:17:01,197 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_accounting.yaml' 2026-09-01T00:17:01,198 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_law.yaml' 2026-09-01T00:17:01,199 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_medicine.yaml' 2026-09-01T00:17:01,201 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_professional_psychology.yaml' 2026-09-01T00:17:01,202 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_public_relations.yaml' 2026-09-01T00:17:01,203 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_security_studies.yaml' 2026-09-01T00:17:01,204 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_sociology.yaml' 2026-09-01T00:17:01,205 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_us_foreign_policy.yaml' 2026-09-01T00:17:01,206 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_virology.yaml' 2026-09-01T00:17:01,207 adding 'lm_eval/tasks/global_mmlu/full/zh/global_mmlu_full_zh_world_religions.yaml' 2026-09-01T00:17:01,208 adding 'lm_eval/tasks/global_mmlu/full/zh/utils.py' 2026-09-01T00:17:01,212 adding 'lm_eval/tasks/global_piqa/README.md' 2026-09-01T00:17:01,213 adding 'lm_eval/tasks/global_piqa/_global_piqa_cloze.yaml' 2026-09-01T00:17:01,214 adding 'lm_eval/tasks/global_piqa/_global_piqa_generation.yaml' 2026-09-01T00:17:01,218 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/_generate_config.py' 2026-09-01T00:17:01,219 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/_global_piqa_nonparallel_cloze.yaml' 2026-09-01T00:17:01,221 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/_template' 2026-09-01T00:17:01,222 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/acm_arab.yaml' 2026-09-01T00:17:01,223 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/acq_arab.yaml' 2026-09-01T00:17:01,224 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/aeb_arab.yaml' 2026-09-01T00:17:01,225 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/afb_arab.yaml' 2026-09-01T00:17:01,226 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/als_latn.yaml' 2026-09-01T00:17:01,227 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/amh_ethi.yaml' 2026-09-01T00:17:01,228 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_jord.yaml' 2026-09-01T00:17:01,230 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_leba.yaml' 2026-09-01T00:17:01,231 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_pale.yaml' 2026-09-01T00:17:01,232 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/apc_arab_syri.yaml' 2026-09-01T00:17:01,233 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/arb_arab.yaml' 2026-09-01T00:17:01,234 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/arq_arab.yaml' 2026-09-01T00:17:01,235 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ars_arab.yaml' 2026-09-01T00:17:01,237 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ary_arab.yaml' 2026-09-01T00:17:01,238 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/arz_arab.yaml' 2026-09-01T00:17:01,239 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/asm_beng.yaml' 2026-09-01T00:17:01,240 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/azj_latn.yaml' 2026-09-01T00:17:01,241 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bam_latn.yaml' 2026-09-01T00:17:01,242 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bcc_arab.yaml' 2026-09-01T00:17:01,243 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bel_cyrl.yaml' 2026-09-01T00:17:01,245 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ben_beng.yaml' 2026-09-01T00:17:01,246 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ben_latn.yaml' 2026-09-01T00:17:01,247 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bgc_deva.yaml' 2026-09-01T00:17:01,248 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bho_deva.yaml' 2026-09-01T00:17:01,249 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bos_latn.yaml' 2026-09-01T00:17:01,251 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bra_deva.yaml' 2026-09-01T00:17:01,252 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bsk_arab.yaml' 2026-09-01T00:17:01,253 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/btx_latn.yaml' 2026-09-01T00:17:01,254 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/bul_cyrl.yaml' 2026-09-01T00:17:01,255 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cat_latn.yaml' 2026-09-01T00:17:01,256 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ces_latn.yaml' 2026-09-01T00:17:01,258 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ckb_arab.yaml' 2026-09-01T00:17:01,259 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ckm_latn.yaml' 2026-09-01T00:17:01,260 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cls_deva.yaml' 2026-09-01T00:17:01,261 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hans.yaml' 2026-09-01T00:17:01,262 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/cmn_hant.yaml' 2026-09-01T00:17:01,263 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/dan_latn.yaml' 2026-09-01T00:17:01,264 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/deu_latn.yaml' 2026-09-01T00:17:01,265 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/dhd_deva.yaml' 2026-09-01T00:17:01,266 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/dje_latn.yaml' 2026-09-01T00:17:01,267 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ekk_latn.yaml' 2026-09-01T00:17:01,268 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ekp_latn.yaml' 2026-09-01T00:17:01,269 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ell_grek.yaml' 2026-09-01T00:17:01,271 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/eng_latn.yaml' 2026-09-01T00:17:01,272 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/eus_latn.yaml' 2026-09-01T00:17:01,273 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fao_latn.yaml' 2026-09-01T00:17:01,274 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fin_latn.yaml' 2026-09-01T00:17:01,275 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_cana.yaml' 2026-09-01T00:17:01,276 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/fra_latn_fran.yaml' 2026-09-01T00:17:01,277 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/glg_latn.yaml' 2026-09-01T00:17:01,278 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/guj_gujr.yaml' 2026-09-01T00:17:01,279 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hau_latn.yaml' 2026-09-01T00:17:01,281 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/haw_latn.yaml' 2026-09-01T00:17:01,282 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/heb_hebr.yaml' 2026-09-01T00:17:01,283 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hin_deva.yaml' 2026-09-01T00:17:01,284 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hin_latn.yaml' 2026-09-01T00:17:01,285 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hrv_latn.yaml' 2026-09-01T00:17:01,286 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hun_latn.yaml' 2026-09-01T00:17:01,287 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/hye_armn.yaml' 2026-09-01T00:17:01,289 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ibo_latn.yaml' 2026-09-01T00:17:01,290 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/idu_latn.yaml' 2026-09-01T00:17:01,291 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ind_latn.yaml' 2026-09-01T00:17:01,292 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/isl_latn.yaml' 2026-09-01T00:17:01,293 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/iso_latn.yaml' 2026-09-01T00:17:01,294 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ita_latn.yaml' 2026-09-01T00:17:01,295 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/jav_latn.yaml' 2026-09-01T00:17:01,297 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/jpn_jpan.yaml' 2026-09-01T00:17:01,298 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kan_knda.yaml' 2026-09-01T00:17:01,299 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kan_latn.yaml' 2026-09-01T00:17:01,300 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kat_geor.yaml' 2026-09-01T00:17:01,301 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kaz_cyrl.yaml' 2026-09-01T00:17:01,302 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kin_latn.yaml' 2026-09-01T00:17:01,304 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kir_cyrl.yaml' 2026-09-01T00:17:01,305 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/kor_hang.yaml' 2026-09-01T00:17:01,306 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/lin_latn.yaml' 2026-09-01T00:17:01,307 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/lit_latn.yaml' 2026-09-01T00:17:01,308 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/luo_latn.yaml' 2026-09-01T00:17:01,309 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mal_mlym.yaml' 2026-09-01T00:17:01,310 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mar_deva.yaml' 2026-09-01T00:17:01,312 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mkd_cyrl.yaml' 2026-09-01T00:17:01,313 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mni_beng.yaml' 2026-09-01T00:17:01,314 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/mni_mtei.yaml' 2026-09-01T00:17:01,315 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nag_latn.yaml' 2026-09-01T00:17:01,316 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nld_latn.yaml' 2026-09-01T00:17:01,317 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nno_latn.yaml' 2026-09-01T00:17:01,318 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/nob_latn.yaml' 2026-09-01T00:17:01,320 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/npi_deva.yaml' 2026-09-01T00:17:01,321 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ory_orya.yaml' 2026-09-01T00:17:01,322 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pan_guru.yaml' 2026-09-01T00:17:01,323 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pcm_latn.yaml' 2026-09-01T00:17:01,324 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pes_arab.yaml' 2026-09-01T00:17:01,325 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/plt_latn.yaml' 2026-09-01T00:17:01,326 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/pol_latn.yaml' 2026-09-01T00:17:01,327 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_braz.yaml' 2026-09-01T00:17:01,328 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/por_latn_port.yaml' 2026-09-01T00:17:01,330 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ron_latn.yaml' 2026-09-01T00:17:01,331 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/rus_cyrl.yaml' 2026-09-01T00:17:01,332 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/rwr_deva.yaml' 2026-09-01T00:17:01,333 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/sin_latn.yaml' 2026-09-01T00:17:01,334 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/sin_sinh.yaml' 2026-09-01T00:17:01,335 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn.yaml' 2026-09-01T00:17:01,336 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slk_latn_sari.yaml' 2026-09-01T00:17:01,338 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn.yaml' 2026-09-01T00:17:01,339 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_cerk.yaml' 2026-09-01T00:17:01,340 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/slv_latn_prle.yaml' 2026-09-01T00:17:01,341 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/snd_arab.yaml' 2026-09-01T00:17:01,342 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/snd_deva.yaml' 2026-09-01T00:17:01,343 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_mexi.yaml' 2026-09-01T00:17:01,344 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_peru.yaml' 2026-09-01T00:17:01,345 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/spa_latn_spai.yaml' 2026-09-01T00:17:01,347 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl.yaml' 2026-09-01T00:17:01,348 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_cyrl_torl.yaml' 2026-09-01T00:17:01,349 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn.yaml' 2026-09-01T00:17:01,350 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/srp_latn_torl.yaml' 2026-09-01T00:17:01,351 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/sun_latn.yaml' 2026-09-01T00:17:01,352 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/swe_latn.yaml' 2026-09-01T00:17:01,353 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/swh_latn.yaml' 2026-09-01T00:17:01,354 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/swv_deva.yaml' 2026-09-01T00:17:01,356 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tam_latn.yaml' 2026-09-01T00:17:01,357 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tam_taml.yaml' 2026-09-01T00:17:01,358 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tel_latn.yaml' 2026-09-01T00:17:01,359 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tel_telu.yaml' 2026-09-01T00:17:01,360 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tgl_latn.yaml' 2026-09-01T00:17:01,361 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tha_thai.yaml' 2026-09-01T00:17:01,362 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/tur_latn.yaml' 2026-09-01T00:17:01,363 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/uig_arab.yaml' 2026-09-01T00:17:01,364 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/ukr_cyrl.yaml' 2026-09-01T00:17:01,365 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/urd_arab.yaml' 2026-09-01T00:17:01,366 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/urd_latn.yaml' 2026-09-01T00:17:01,368 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/urh_latn.yaml' 2026-09-01T00:17:01,369 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/uzn_latn.yaml' 2026-09-01T00:17:01,370 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/vie_latn.yaml' 2026-09-01T00:17:01,371 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/yor_latn.yaml' 2026-09-01T00:17:01,372 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/yue_hant.yaml' 2026-09-01T00:17:01,373 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/zsm_latn.yaml' 2026-09-01T00:17:01,374 adding 'lm_eval/tasks/global_piqa/nonparallel_cloze/zul_latn.yaml' 2026-09-01T00:17:01,378 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/_generate_config.py' 2026-09-01T00:17:01,379 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/_global_piqa_nonparallel_generation.yaml' 2026-09-01T00:17:01,381 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/_template' 2026-09-01T00:17:01,382 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/acm_arab.yaml' 2026-09-01T00:17:01,383 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/acq_arab.yaml' 2026-09-01T00:17:01,384 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/aeb_arab.yaml' 2026-09-01T00:17:01,385 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/afb_arab.yaml' 2026-09-01T00:17:01,386 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/als_latn.yaml' 2026-09-01T00:17:01,387 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/amh_ethi.yaml' 2026-09-01T00:17:01,389 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_jord.yaml' 2026-09-01T00:17:01,390 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_leba.yaml' 2026-09-01T00:17:01,391 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_pale.yaml' 2026-09-01T00:17:01,392 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/apc_arab_syri.yaml' 2026-09-01T00:17:01,393 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/arb_arab.yaml' 2026-09-01T00:17:01,394 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/arq_arab.yaml' 2026-09-01T00:17:01,395 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ars_arab.yaml' 2026-09-01T00:17:01,397 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ary_arab.yaml' 2026-09-01T00:17:01,398 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/arz_arab.yaml' 2026-09-01T00:17:01,399 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/asm_beng.yaml' 2026-09-01T00:17:01,400 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/azj_latn.yaml' 2026-09-01T00:17:01,401 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bam_latn.yaml' 2026-09-01T00:17:01,402 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bcc_arab.yaml' 2026-09-01T00:17:01,403 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bel_cyrl.yaml' 2026-09-01T00:17:01,404 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ben_beng.yaml' 2026-09-01T00:17:01,406 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ben_latn.yaml' 2026-09-01T00:17:01,407 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bgc_deva.yaml' 2026-09-01T00:17:01,408 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bho_deva.yaml' 2026-09-01T00:17:01,409 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bos_latn.yaml' 2026-09-01T00:17:01,410 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bra_deva.yaml' 2026-09-01T00:17:01,411 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bsk_arab.yaml' 2026-09-01T00:17:01,412 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/btx_latn.yaml' 2026-09-01T00:17:01,413 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/bul_cyrl.yaml' 2026-09-01T00:17:01,414 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cat_latn.yaml' 2026-09-01T00:17:01,415 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ces_latn.yaml' 2026-09-01T00:17:01,416 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ckb_arab.yaml' 2026-09-01T00:17:01,417 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ckm_latn.yaml' 2026-09-01T00:17:01,418 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cls_deva.yaml' 2026-09-01T00:17:01,419 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hans.yaml' 2026-09-01T00:17:01,421 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/cmn_hant.yaml' 2026-09-01T00:17:01,422 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/dan_latn.yaml' 2026-09-01T00:17:01,423 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/deu_latn.yaml' 2026-09-01T00:17:01,424 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/dhd_deva.yaml' 2026-09-01T00:17:01,425 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/dje_latn.yaml' 2026-09-01T00:17:01,426 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ekk_latn.yaml' 2026-09-01T00:17:01,427 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ekp_latn.yaml' 2026-09-01T00:17:01,428 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ell_grek.yaml' 2026-09-01T00:17:01,430 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/eng_latn.yaml' 2026-09-01T00:17:01,431 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/eus_latn.yaml' 2026-09-01T00:17:01,432 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fao_latn.yaml' 2026-09-01T00:17:01,433 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fin_latn.yaml' 2026-09-01T00:17:01,434 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_cana.yaml' 2026-09-01T00:17:01,435 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/fra_latn_fran.yaml' 2026-09-01T00:17:01,436 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/glg_latn.yaml' 2026-09-01T00:17:01,438 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/guj_gujr.yaml' 2026-09-01T00:17:01,439 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hau_latn.yaml' 2026-09-01T00:17:01,440 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/haw_latn.yaml' 2026-09-01T00:17:01,441 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/heb_hebr.yaml' 2026-09-01T00:17:01,442 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hin_deva.yaml' 2026-09-01T00:17:01,443 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hin_latn.yaml' 2026-09-01T00:17:01,444 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hrv_latn.yaml' 2026-09-01T00:17:01,445 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hun_latn.yaml' 2026-09-01T00:17:01,447 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/hye_armn.yaml' 2026-09-01T00:17:01,448 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ibo_latn.yaml' 2026-09-01T00:17:01,449 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/idu_latn.yaml' 2026-09-01T00:17:01,450 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ind_latn.yaml' 2026-09-01T00:17:01,451 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/isl_latn.yaml' 2026-09-01T00:17:01,452 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/iso_latn.yaml' 2026-09-01T00:17:01,453 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ita_latn.yaml' 2026-09-01T00:17:01,454 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/jav_latn.yaml' 2026-09-01T00:17:01,456 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/jpn_jpan.yaml' 2026-09-01T00:17:01,457 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kan_knda.yaml' 2026-09-01T00:17:01,458 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kan_latn.yaml' 2026-09-01T00:17:01,459 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kat_geor.yaml' 2026-09-01T00:17:01,460 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kaz_cyrl.yaml' 2026-09-01T00:17:01,461 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kin_latn.yaml' 2026-09-01T00:17:01,462 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kir_cyrl.yaml' 2026-09-01T00:17:01,463 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/kor_hang.yaml' 2026-09-01T00:17:01,464 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/lin_latn.yaml' 2026-09-01T00:17:01,465 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/lit_latn.yaml' 2026-09-01T00:17:01,466 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/luo_latn.yaml' 2026-09-01T00:17:01,467 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mal_mlym.yaml' 2026-09-01T00:17:01,468 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mar_deva.yaml' 2026-09-01T00:17:01,469 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mkd_cyrl.yaml' 2026-09-01T00:17:01,471 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mni_beng.yaml' 2026-09-01T00:17:01,472 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/mni_mtei.yaml' 2026-09-01T00:17:01,473 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nag_latn.yaml' 2026-09-01T00:17:01,474 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nld_latn.yaml' 2026-09-01T00:17:01,475 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nno_latn.yaml' 2026-09-01T00:17:01,476 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/nob_latn.yaml' 2026-09-01T00:17:01,477 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/npi_deva.yaml' 2026-09-01T00:17:01,478 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ory_orya.yaml' 2026-09-01T00:17:01,479 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pan_guru.yaml' 2026-09-01T00:17:01,481 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pcm_latn.yaml' 2026-09-01T00:17:01,482 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pes_arab.yaml' 2026-09-01T00:17:01,483 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/plt_latn.yaml' 2026-09-01T00:17:01,484 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/pol_latn.yaml' 2026-09-01T00:17:01,485 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_braz.yaml' 2026-09-01T00:17:01,486 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/por_latn_port.yaml' 2026-09-01T00:17:01,487 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ron_latn.yaml' 2026-09-01T00:17:01,488 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/rus_cyrl.yaml' 2026-09-01T00:17:01,489 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/rwr_deva.yaml' 2026-09-01T00:17:01,491 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/sin_latn.yaml' 2026-09-01T00:17:01,492 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/sin_sinh.yaml' 2026-09-01T00:17:01,493 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn.yaml' 2026-09-01T00:17:01,494 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slk_latn_sari.yaml' 2026-09-01T00:17:01,495 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn.yaml' 2026-09-01T00:17:01,496 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_cerk.yaml' 2026-09-01T00:17:01,498 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/slv_latn_prle.yaml' 2026-09-01T00:17:01,499 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/snd_arab.yaml' 2026-09-01T00:17:01,500 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/snd_deva.yaml' 2026-09-01T00:17:01,501 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_mexi.yaml' 2026-09-01T00:17:01,502 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_peru.yaml' 2026-09-01T00:17:01,503 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/spa_latn_spai.yaml' 2026-09-01T00:17:01,504 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl.yaml' 2026-09-01T00:17:01,505 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_cyrl_torl.yaml' 2026-09-01T00:17:01,506 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn.yaml' 2026-09-01T00:17:01,507 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/srp_latn_torl.yaml' 2026-09-01T00:17:01,508 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/sun_latn.yaml' 2026-09-01T00:17:01,509 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/swe_latn.yaml' 2026-09-01T00:17:01,510 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/swh_latn.yaml' 2026-09-01T00:17:01,511 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/swv_deva.yaml' 2026-09-01T00:17:01,512 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tam_latn.yaml' 2026-09-01T00:17:01,513 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tam_taml.yaml' 2026-09-01T00:17:01,514 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tel_latn.yaml' 2026-09-01T00:17:01,515 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tel_telu.yaml' 2026-09-01T00:17:01,516 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tgl_latn.yaml' 2026-09-01T00:17:01,518 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tha_thai.yaml' 2026-09-01T00:17:01,519 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/tur_latn.yaml' 2026-09-01T00:17:01,520 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/uig_arab.yaml' 2026-09-01T00:17:01,521 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/ukr_cyrl.yaml' 2026-09-01T00:17:01,522 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/urd_arab.yaml' 2026-09-01T00:17:01,523 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/urd_latn.yaml' 2026-09-01T00:17:01,524 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/urh_latn.yaml' 2026-09-01T00:17:01,525 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/uzn_latn.yaml' 2026-09-01T00:17:01,526 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/vie_latn.yaml' 2026-09-01T00:17:01,527 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/yor_latn.yaml' 2026-09-01T00:17:01,528 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/yue_hant.yaml' 2026-09-01T00:17:01,530 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/zsm_latn.yaml' 2026-09-01T00:17:01,531 adding 'lm_eval/tasks/global_piqa/nonparallel_generation/zul_latn.yaml' 2026-09-01T00:17:01,535 adding 'lm_eval/tasks/global_piqa/parallel_cloze/_generate_config.py' 2026-09-01T00:17:01,536 adding 'lm_eval/tasks/global_piqa/parallel_cloze/_global_piqa_parallel_cloze.yaml' 2026-09-01T00:17:01,537 adding 'lm_eval/tasks/global_piqa/parallel_cloze/_template' 2026-09-01T00:17:01,538 adding 'lm_eval/tasks/global_piqa/parallel_cloze/acm_arab.yaml' 2026-09-01T00:17:01,540 adding 'lm_eval/tasks/global_piqa/parallel_cloze/acq_arab.yaml' 2026-09-01T00:17:01,541 adding 'lm_eval/tasks/global_piqa/parallel_cloze/aeb_arab.yaml' 2026-09-01T00:17:01,542 adding 'lm_eval/tasks/global_piqa/parallel_cloze/afb_arab.yaml' 2026-09-01T00:17:01,543 adding 'lm_eval/tasks/global_piqa/parallel_cloze/als_latn.yaml' 2026-09-01T00:17:01,544 adding 'lm_eval/tasks/global_piqa/parallel_cloze/amh_ethi.yaml' 2026-09-01T00:17:01,545 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_jord.yaml' 2026-09-01T00:17:01,546 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_leba.yaml' 2026-09-01T00:17:01,548 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_pale.yaml' 2026-09-01T00:17:01,549 adding 'lm_eval/tasks/global_piqa/parallel_cloze/apc_arab_syri.yaml' 2026-09-01T00:17:01,550 adding 'lm_eval/tasks/global_piqa/parallel_cloze/arb_arab.yaml' 2026-09-01T00:17:01,551 adding 'lm_eval/tasks/global_piqa/parallel_cloze/arq_arab.yaml' 2026-09-01T00:17:01,552 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ars_arab.yaml' 2026-09-01T00:17:01,553 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ary_arab.yaml' 2026-09-01T00:17:01,554 adding 'lm_eval/tasks/global_piqa/parallel_cloze/arz_arab.yaml' 2026-09-01T00:17:01,555 adding 'lm_eval/tasks/global_piqa/parallel_cloze/azj_latn.yaml' 2026-09-01T00:17:01,556 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bam_latn.yaml' 2026-09-01T00:17:01,557 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bcc_arab.yaml' 2026-09-01T00:17:01,558 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bel_cyrl.yaml' 2026-09-01T00:17:01,559 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ben_beng.yaml' 2026-09-01T00:17:01,560 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ben_latn.yaml' 2026-09-01T00:17:01,561 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bgc_deva.yaml' 2026-09-01T00:17:01,562 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bho_deva.yaml' 2026-09-01T00:17:01,563 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bra_deva.yaml' 2026-09-01T00:17:01,564 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bul_cyrl.yaml' 2026-09-01T00:17:01,566 adding 'lm_eval/tasks/global_piqa/parallel_cloze/bxr_cyrl.yaml' 2026-09-01T00:17:01,567 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cat_latn.yaml' 2026-09-01T00:17:01,568 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ceb_latn.yaml' 2026-09-01T00:17:01,569 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ces_latn.yaml' 2026-09-01T00:17:01,570 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ckm_latn.yaml' 2026-09-01T00:17:01,571 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cls_deva.yaml' 2026-09-01T00:17:01,572 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cmn_hans.yaml' 2026-09-01T00:17:01,573 adding 'lm_eval/tasks/global_piqa/parallel_cloze/cmn_hant.yaml' 2026-09-01T00:17:01,574 adding 'lm_eval/tasks/global_piqa/parallel_cloze/dan_latn.yaml' 2026-09-01T00:17:01,576 adding 'lm_eval/tasks/global_piqa/parallel_cloze/deu_latn.yaml' 2026-09-01T00:17:01,577 adding 'lm_eval/tasks/global_piqa/parallel_cloze/dhd_deva.yaml' 2026-09-01T00:17:01,578 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ekk_latn.yaml' 2026-09-01T00:17:01,579 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ekp_latn.yaml' 2026-09-01T00:17:01,580 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ell_grek.yaml' 2026-09-01T00:17:01,581 adding 'lm_eval/tasks/global_piqa/parallel_cloze/eng_latn.yaml' 2026-09-01T00:17:01,582 adding 'lm_eval/tasks/global_piqa/parallel_cloze/eus_latn.yaml' 2026-09-01T00:17:01,584 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fao_latn.yaml' 2026-09-01T00:17:01,585 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fin_latn.yaml' 2026-09-01T00:17:01,586 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_cana.yaml' 2026-09-01T00:17:01,587 adding 'lm_eval/tasks/global_piqa/parallel_cloze/fra_latn_fran.yaml' 2026-09-01T00:17:01,588 adding 'lm_eval/tasks/global_piqa/parallel_cloze/glg_latn.yaml' 2026-09-01T00:17:01,589 adding 'lm_eval/tasks/global_piqa/parallel_cloze/guj_gujr.yaml' 2026-09-01T00:17:01,590 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hau_latn.yaml' 2026-09-01T00:17:01,592 adding 'lm_eval/tasks/global_piqa/parallel_cloze/haw_latn.yaml' 2026-09-01T00:17:01,593 adding 'lm_eval/tasks/global_piqa/parallel_cloze/heb_hebr.yaml' 2026-09-01T00:17:01,594 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hin_deva.yaml' 2026-09-01T00:17:01,595 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hin_latn.yaml' 2026-09-01T00:17:01,596 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hrv_latn.yaml' 2026-09-01T00:17:01,597 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hun_latn.yaml' 2026-09-01T00:17:01,598 adding 'lm_eval/tasks/global_piqa/parallel_cloze/hye_armn.yaml' 2026-09-01T00:17:01,600 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ibo_latn.yaml' 2026-09-01T00:17:01,600 adding 'lm_eval/tasks/global_piqa/parallel_cloze/idu_latn.yaml' 2026-09-01T00:17:01,601 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ilo_latn.yaml' 2026-09-01T00:17:01,602 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ind_latn.yaml' 2026-09-01T00:17:01,603 adding 'lm_eval/tasks/global_piqa/parallel_cloze/isl_latn.yaml' 2026-09-01T00:17:01,604 adding 'lm_eval/tasks/global_piqa/parallel_cloze/iso_latn.yaml' 2026-09-01T00:17:01,606 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ita_latn.yaml' 2026-09-01T00:17:01,607 adding 'lm_eval/tasks/global_piqa/parallel_cloze/jav_latn.yaml' 2026-09-01T00:17:01,608 adding 'lm_eval/tasks/global_piqa/parallel_cloze/jpn_jpan.yaml' 2026-09-01T00:17:01,609 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kan_knda.yaml' 2026-09-01T00:17:01,610 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kan_latn.yaml' 2026-09-01T00:17:01,611 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kat_geor.yaml' 2026-09-01T00:17:01,613 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kin_latn.yaml' 2026-09-01T00:17:01,614 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kir_cyrl.yaml' 2026-09-01T00:17:01,615 adding 'lm_eval/tasks/global_piqa/parallel_cloze/kor_hang.yaml' 2026-09-01T00:17:01,616 adding 'lm_eval/tasks/global_piqa/parallel_cloze/lin_latn.yaml' 2026-09-01T00:17:01,617 adding 'lm_eval/tasks/global_piqa/parallel_cloze/lit_latn.yaml' 2026-09-01T00:17:01,619 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mag_deva.yaml' 2026-09-01T00:17:01,620 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mal_mlym.yaml' 2026-09-01T00:17:01,621 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mar_deva.yaml' 2026-09-01T00:17:01,622 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mkd_cyrl.yaml' 2026-09-01T00:17:01,623 adding 'lm_eval/tasks/global_piqa/parallel_cloze/mni_beng.yaml' 2026-09-01T00:17:01,624 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nag_latn.yaml' 2026-09-01T00:17:01,625 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nld_latn.yaml' 2026-09-01T00:17:01,626 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nno_latn.yaml' 2026-09-01T00:17:01,628 adding 'lm_eval/tasks/global_piqa/parallel_cloze/nob_latn.yaml' 2026-09-01T00:17:01,629 adding 'lm_eval/tasks/global_piqa/parallel_cloze/npi_deva.yaml' 2026-09-01T00:17:01,630 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ory_orya.yaml' 2026-09-01T00:17:01,631 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pan_guru.yaml' 2026-09-01T00:17:01,632 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pcm_latn.yaml' 2026-09-01T00:17:01,633 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pes_arab.yaml' 2026-09-01T00:17:01,634 adding 'lm_eval/tasks/global_piqa/parallel_cloze/plt_latn.yaml' 2026-09-01T00:17:01,636 adding 'lm_eval/tasks/global_piqa/parallel_cloze/pol_latn.yaml' 2026-09-01T00:17:01,637 adding 'lm_eval/tasks/global_piqa/parallel_cloze/por_latn_braz.yaml' 2026-09-01T00:17:01,638 adding 'lm_eval/tasks/global_piqa/parallel_cloze/por_latn_port.yaml' 2026-09-01T00:17:01,639 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ron_latn.yaml' 2026-09-01T00:17:01,640 adding 'lm_eval/tasks/global_piqa/parallel_cloze/rus_cyrl.yaml' 2026-09-01T00:17:01,641 adding 'lm_eval/tasks/global_piqa/parallel_cloze/rwr_deva.yaml' 2026-09-01T00:17:01,642 adding 'lm_eval/tasks/global_piqa/parallel_cloze/sin_latn.yaml' 2026-09-01T00:17:01,643 adding 'lm_eval/tasks/global_piqa/parallel_cloze/sin_sinh.yaml' 2026-09-01T00:17:01,645 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slk_latn.yaml' 2026-09-01T00:17:01,646 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slk_latn_sari.yaml' 2026-09-01T00:17:01,647 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slv_latn.yaml' 2026-09-01T00:17:01,648 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_cerk.yaml' 2026-09-01T00:17:01,649 adding 'lm_eval/tasks/global_piqa/parallel_cloze/slv_latn_prle.yaml' 2026-09-01T00:17:01,651 adding 'lm_eval/tasks/global_piqa/parallel_cloze/snd_arab.yaml' 2026-09-01T00:17:01,652 adding 'lm_eval/tasks/global_piqa/parallel_cloze/snd_deva.yaml' 2026-09-01T00:17:01,653 adding 'lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_mexi.yaml' 2026-09-01T00:17:01,654 adding 'lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_peru.yaml' 2026-09-01T00:17:01,655 adding 'lm_eval/tasks/global_piqa/parallel_cloze/spa_latn_spai.yaml' 2026-09-01T00:17:01,656 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl.yaml' 2026-09-01T00:17:01,658 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_cyrl_torl.yaml' 2026-09-01T00:17:01,659 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_latn.yaml' 2026-09-01T00:17:01,660 adding 'lm_eval/tasks/global_piqa/parallel_cloze/srp_latn_torl.yaml' 2026-09-01T00:17:01,661 adding 'lm_eval/tasks/global_piqa/parallel_cloze/swe_latn.yaml' 2026-09-01T00:17:01,662 adding 'lm_eval/tasks/global_piqa/parallel_cloze/swh_latn.yaml' 2026-09-01T00:17:01,663 adding 'lm_eval/tasks/global_piqa/parallel_cloze/swv_deva.yaml' 2026-09-01T00:17:01,664 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tam_latn.yaml' 2026-09-01T00:17:01,665 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tam_taml.yaml' 2026-09-01T00:17:01,666 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tel_latn.yaml' 2026-09-01T00:17:01,667 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tel_telu.yaml' 2026-09-01T00:17:01,668 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tgl_latn.yaml' 2026-09-01T00:17:01,669 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tha_thai.yaml' 2026-09-01T00:17:01,670 adding 'lm_eval/tasks/global_piqa/parallel_cloze/tur_latn.yaml' 2026-09-01T00:17:01,671 adding 'lm_eval/tasks/global_piqa/parallel_cloze/uig_arab.yaml' 2026-09-01T00:17:01,673 adding 'lm_eval/tasks/global_piqa/parallel_cloze/ukr_cyrl.yaml' 2026-09-01T00:17:01,674 adding 'lm_eval/tasks/global_piqa/parallel_cloze/urd_arab.yaml' 2026-09-01T00:17:01,675 adding 'lm_eval/tasks/global_piqa/parallel_cloze/urd_latn.yaml' 2026-09-01T00:17:01,676 adding 'lm_eval/tasks/global_piqa/parallel_cloze/urh_latn.yaml' 2026-09-01T00:17:01,677 adding 'lm_eval/tasks/global_piqa/parallel_cloze/uzn_latn.yaml' 2026-09-01T00:17:01,678 adding 'lm_eval/tasks/global_piqa/parallel_cloze/vie_latn.yaml' 2026-09-01T00:17:01,679 adding 'lm_eval/tasks/global_piqa/parallel_cloze/xho_latn.yaml' 2026-09-01T00:17:01,681 adding 'lm_eval/tasks/global_piqa/parallel_cloze/yor_latn.yaml' 2026-09-01T00:17:01,682 adding 'lm_eval/tasks/global_piqa/parallel_cloze/yue_hant.yaml' 2026-09-01T00:17:01,683 adding 'lm_eval/tasks/global_piqa/parallel_cloze/zsm_latn.yaml' 2026-09-01T00:17:01,684 adding 'lm_eval/tasks/global_piqa/parallel_cloze/zul_latn.yaml' 2026-09-01T00:17:01,688 adding 'lm_eval/tasks/global_piqa/parallel_generation/_generate_config.py' 2026-09-01T00:17:01,690 adding 'lm_eval/tasks/global_piqa/parallel_generation/_global_piqa_parallel_generation.yaml' 2026-09-01T00:17:01,691 adding 'lm_eval/tasks/global_piqa/parallel_generation/_template' 2026-09-01T00:17:01,692 adding 'lm_eval/tasks/global_piqa/parallel_generation/acm_arab.yaml' 2026-09-01T00:17:01,694 adding 'lm_eval/tasks/global_piqa/parallel_generation/acq_arab.yaml' 2026-09-01T00:17:01,695 adding 'lm_eval/tasks/global_piqa/parallel_generation/aeb_arab.yaml' 2026-09-01T00:17:01,696 adding 'lm_eval/tasks/global_piqa/parallel_generation/afb_arab.yaml' 2026-09-01T00:17:01,698 adding 'lm_eval/tasks/global_piqa/parallel_generation/als_latn.yaml' 2026-09-01T00:17:01,699 adding 'lm_eval/tasks/global_piqa/parallel_generation/amh_ethi.yaml' 2026-09-01T00:17:01,700 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_jord.yaml' 2026-09-01T00:17:01,702 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_leba.yaml' 2026-09-01T00:17:01,703 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_pale.yaml' 2026-09-01T00:17:01,704 adding 'lm_eval/tasks/global_piqa/parallel_generation/apc_arab_syri.yaml' 2026-09-01T00:17:01,705 adding 'lm_eval/tasks/global_piqa/parallel_generation/arb_arab.yaml' 2026-09-01T00:17:01,706 adding 'lm_eval/tasks/global_piqa/parallel_generation/arq_arab.yaml' 2026-09-01T00:17:01,707 adding 'lm_eval/tasks/global_piqa/parallel_generation/ars_arab.yaml' 2026-09-01T00:17:01,708 adding 'lm_eval/tasks/global_piqa/parallel_generation/ary_arab.yaml' 2026-09-01T00:17:01,709 adding 'lm_eval/tasks/global_piqa/parallel_generation/arz_arab.yaml' 2026-09-01T00:17:01,710 adding 'lm_eval/tasks/global_piqa/parallel_generation/azj_latn.yaml' 2026-09-01T00:17:01,711 adding 'lm_eval/tasks/global_piqa/parallel_generation/bam_latn.yaml' 2026-09-01T00:17:01,712 adding 'lm_eval/tasks/global_piqa/parallel_generation/bcc_arab.yaml' 2026-09-01T00:17:01,713 adding 'lm_eval/tasks/global_piqa/parallel_generation/bel_cyrl.yaml' 2026-09-01T00:17:01,714 adding 'lm_eval/tasks/global_piqa/parallel_generation/ben_beng.yaml' 2026-09-01T00:17:01,715 adding 'lm_eval/tasks/global_piqa/parallel_generation/ben_latn.yaml' 2026-09-01T00:17:01,716 adding 'lm_eval/tasks/global_piqa/parallel_generation/bgc_deva.yaml' 2026-09-01T00:17:01,718 adding 'lm_eval/tasks/global_piqa/parallel_generation/bho_deva.yaml' 2026-09-01T00:17:01,719 adding 'lm_eval/tasks/global_piqa/parallel_generation/bra_deva.yaml' 2026-09-01T00:17:01,720 adding 'lm_eval/tasks/global_piqa/parallel_generation/bul_cyrl.yaml' 2026-09-01T00:17:01,721 adding 'lm_eval/tasks/global_piqa/parallel_generation/bxr_cyrl.yaml' 2026-09-01T00:17:01,722 adding 'lm_eval/tasks/global_piqa/parallel_generation/cat_latn.yaml' 2026-09-01T00:17:01,723 adding 'lm_eval/tasks/global_piqa/parallel_generation/ceb_latn.yaml' 2026-09-01T00:17:01,724 adding 'lm_eval/tasks/global_piqa/parallel_generation/ces_latn.yaml' 2026-09-01T00:17:01,725 adding 'lm_eval/tasks/global_piqa/parallel_generation/ckm_latn.yaml' 2026-09-01T00:17:01,726 adding 'lm_eval/tasks/global_piqa/parallel_generation/cls_deva.yaml' 2026-09-01T00:17:01,728 adding 'lm_eval/tasks/global_piqa/parallel_generation/cmn_hans.yaml' 2026-09-01T00:17:01,729 adding 'lm_eval/tasks/global_piqa/parallel_generation/cmn_hant.yaml' 2026-09-01T00:17:01,730 adding 'lm_eval/tasks/global_piqa/parallel_generation/dan_latn.yaml' 2026-09-01T00:17:01,731 adding 'lm_eval/tasks/global_piqa/parallel_generation/deu_latn.yaml' 2026-09-01T00:17:01,732 adding 'lm_eval/tasks/global_piqa/parallel_generation/dhd_deva.yaml' 2026-09-01T00:17:01,733 adding 'lm_eval/tasks/global_piqa/parallel_generation/ekk_latn.yaml' 2026-09-01T00:17:01,734 adding 'lm_eval/tasks/global_piqa/parallel_generation/ekp_latn.yaml' 2026-09-01T00:17:01,735 adding 'lm_eval/tasks/global_piqa/parallel_generation/ell_grek.yaml' 2026-09-01T00:17:01,736 adding 'lm_eval/tasks/global_piqa/parallel_generation/eng_latn.yaml' 2026-09-01T00:17:01,738 adding 'lm_eval/tasks/global_piqa/parallel_generation/eus_latn.yaml' 2026-09-01T00:17:01,739 adding 'lm_eval/tasks/global_piqa/parallel_generation/fao_latn.yaml' 2026-09-01T00:17:01,740 adding 'lm_eval/tasks/global_piqa/parallel_generation/fin_latn.yaml' 2026-09-01T00:17:01,741 adding 'lm_eval/tasks/global_piqa/parallel_generation/fra_latn_cana.yaml' 2026-09-01T00:17:01,742 adding 'lm_eval/tasks/global_piqa/parallel_generation/fra_latn_fran.yaml' 2026-09-01T00:17:01,744 adding 'lm_eval/tasks/global_piqa/parallel_generation/glg_latn.yaml' 2026-09-01T00:17:01,745 adding 'lm_eval/tasks/global_piqa/parallel_generation/guj_gujr.yaml' 2026-09-01T00:17:01,747 adding 'lm_eval/tasks/global_piqa/parallel_generation/hau_latn.yaml' 2026-09-01T00:17:01,750 adding 'lm_eval/tasks/global_piqa/parallel_generation/haw_latn.yaml' 2026-09-01T00:17:01,752 adding 'lm_eval/tasks/global_piqa/parallel_generation/heb_hebr.yaml' 2026-09-01T00:17:01,753 adding 'lm_eval/tasks/global_piqa/parallel_generation/hin_deva.yaml' 2026-09-01T00:17:01,754 adding 'lm_eval/tasks/global_piqa/parallel_generation/hin_latn.yaml' 2026-09-01T00:17:01,756 adding 'lm_eval/tasks/global_piqa/parallel_generation/hrv_latn.yaml' 2026-09-01T00:17:01,757 adding 'lm_eval/tasks/global_piqa/parallel_generation/hun_latn.yaml' 2026-09-01T00:17:01,758 adding 'lm_eval/tasks/global_piqa/parallel_generation/hye_armn.yaml' 2026-09-01T00:17:01,759 adding 'lm_eval/tasks/global_piqa/parallel_generation/ibo_latn.yaml' 2026-09-01T00:17:01,760 adding 'lm_eval/tasks/global_piqa/parallel_generation/idu_latn.yaml' 2026-09-01T00:17:01,761 adding 'lm_eval/tasks/global_piqa/parallel_generation/ilo_latn.yaml' 2026-09-01T00:17:01,762 adding 'lm_eval/tasks/global_piqa/parallel_generation/ind_latn.yaml' 2026-09-01T00:17:01,763 adding 'lm_eval/tasks/global_piqa/parallel_generation/isl_latn.yaml' 2026-09-01T00:17:01,764 adding 'lm_eval/tasks/global_piqa/parallel_generation/iso_latn.yaml' 2026-09-01T00:17:01,765 adding 'lm_eval/tasks/global_piqa/parallel_generation/ita_latn.yaml' 2026-09-01T00:17:01,767 adding 'lm_eval/tasks/global_piqa/parallel_generation/jav_latn.yaml' 2026-09-01T00:17:01,768 adding 'lm_eval/tasks/global_piqa/parallel_generation/jpn_jpan.yaml' 2026-09-01T00:17:01,769 adding 'lm_eval/tasks/global_piqa/parallel_generation/kan_knda.yaml' 2026-09-01T00:17:01,770 adding 'lm_eval/tasks/global_piqa/parallel_generation/kan_latn.yaml' 2026-09-01T00:17:01,771 adding 'lm_eval/tasks/global_piqa/parallel_generation/kat_geor.yaml' 2026-09-01T00:17:01,772 adding 'lm_eval/tasks/global_piqa/parallel_generation/kin_latn.yaml' 2026-09-01T00:17:01,773 adding 'lm_eval/tasks/global_piqa/parallel_generation/kir_cyrl.yaml' 2026-09-01T00:17:01,775 adding 'lm_eval/tasks/global_piqa/parallel_generation/kor_hang.yaml' 2026-09-01T00:17:01,776 adding 'lm_eval/tasks/global_piqa/parallel_generation/lin_latn.yaml' 2026-09-01T00:17:01,777 adding 'lm_eval/tasks/global_piqa/parallel_generation/lit_latn.yaml' 2026-09-01T00:17:01,778 adding 'lm_eval/tasks/global_piqa/parallel_generation/mag_deva.yaml' 2026-09-01T00:17:01,779 adding 'lm_eval/tasks/global_piqa/parallel_generation/mal_mlym.yaml' 2026-09-01T00:17:01,780 adding 'lm_eval/tasks/global_piqa/parallel_generation/mar_deva.yaml' 2026-09-01T00:17:01,781 adding 'lm_eval/tasks/global_piqa/parallel_generation/mkd_cyrl.yaml' 2026-09-01T00:17:01,782 adding 'lm_eval/tasks/global_piqa/parallel_generation/mni_beng.yaml' 2026-09-01T00:17:01,783 adding 'lm_eval/tasks/global_piqa/parallel_generation/nag_latn.yaml' 2026-09-01T00:17:01,784 adding 'lm_eval/tasks/global_piqa/parallel_generation/nld_latn.yaml' 2026-09-01T00:17:01,785 adding 'lm_eval/tasks/global_piqa/parallel_generation/nno_latn.yaml' 2026-09-01T00:17:01,787 adding 'lm_eval/tasks/global_piqa/parallel_generation/nob_latn.yaml' 2026-09-01T00:17:01,788 adding 'lm_eval/tasks/global_piqa/parallel_generation/npi_deva.yaml' 2026-09-01T00:17:01,789 adding 'lm_eval/tasks/global_piqa/parallel_generation/ory_orya.yaml' 2026-09-01T00:17:01,790 adding 'lm_eval/tasks/global_piqa/parallel_generation/pan_guru.yaml' 2026-09-01T00:17:01,791 adding 'lm_eval/tasks/global_piqa/parallel_generation/pcm_latn.yaml' 2026-09-01T00:17:01,792 adding 'lm_eval/tasks/global_piqa/parallel_generation/pes_arab.yaml' 2026-09-01T00:17:01,793 adding 'lm_eval/tasks/global_piqa/parallel_generation/plt_latn.yaml' 2026-09-01T00:17:01,794 adding 'lm_eval/tasks/global_piqa/parallel_generation/pol_latn.yaml' 2026-09-01T00:17:01,796 adding 'lm_eval/tasks/global_piqa/parallel_generation/por_latn_braz.yaml' 2026-09-01T00:17:01,797 adding 'lm_eval/tasks/global_piqa/parallel_generation/por_latn_port.yaml' 2026-09-01T00:17:01,798 adding 'lm_eval/tasks/global_piqa/parallel_generation/ron_latn.yaml' 2026-09-01T00:17:01,799 adding 'lm_eval/tasks/global_piqa/parallel_generation/rus_cyrl.yaml' 2026-09-01T00:17:01,800 adding 'lm_eval/tasks/global_piqa/parallel_generation/rwr_deva.yaml' 2026-09-01T00:17:01,801 adding 'lm_eval/tasks/global_piqa/parallel_generation/sin_latn.yaml' 2026-09-01T00:17:01,802 adding 'lm_eval/tasks/global_piqa/parallel_generation/sin_sinh.yaml' 2026-09-01T00:17:01,803 adding 'lm_eval/tasks/global_piqa/parallel_generation/slk_latn.yaml' 2026-09-01T00:17:01,804 adding 'lm_eval/tasks/global_piqa/parallel_generation/slk_latn_sari.yaml' 2026-09-01T00:17:01,805 adding 'lm_eval/tasks/global_piqa/parallel_generation/slv_latn.yaml' 2026-09-01T00:17:01,806 adding 'lm_eval/tasks/global_piqa/parallel_generation/slv_latn_cerk.yaml' 2026-09-01T00:17:01,807 adding 'lm_eval/tasks/global_piqa/parallel_generation/slv_latn_prle.yaml' 2026-09-01T00:17:01,808 adding 'lm_eval/tasks/global_piqa/parallel_generation/snd_arab.yaml' 2026-09-01T00:17:01,809 adding 'lm_eval/tasks/global_piqa/parallel_generation/snd_deva.yaml' 2026-09-01T00:17:01,810 adding 'lm_eval/tasks/global_piqa/parallel_generation/spa_latn_mexi.yaml' 2026-09-01T00:17:01,811 adding 'lm_eval/tasks/global_piqa/parallel_generation/spa_latn_peru.yaml' 2026-09-01T00:17:01,813 adding 'lm_eval/tasks/global_piqa/parallel_generation/spa_latn_spai.yaml' 2026-09-01T00:17:01,814 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl.yaml' 2026-09-01T00:17:01,815 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_cyrl_torl.yaml' 2026-09-01T00:17:01,816 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_latn.yaml' 2026-09-01T00:17:01,817 adding 'lm_eval/tasks/global_piqa/parallel_generation/srp_latn_torl.yaml' 2026-09-01T00:17:01,818 adding 'lm_eval/tasks/global_piqa/parallel_generation/swe_latn.yaml' 2026-09-01T00:17:01,819 adding 'lm_eval/tasks/global_piqa/parallel_generation/swh_latn.yaml' 2026-09-01T00:17:01,820 adding 'lm_eval/tasks/global_piqa/parallel_generation/swv_deva.yaml' 2026-09-01T00:17:01,822 adding 'lm_eval/tasks/global_piqa/parallel_generation/tam_latn.yaml' 2026-09-01T00:17:01,823 adding 'lm_eval/tasks/global_piqa/parallel_generation/tam_taml.yaml' 2026-09-01T00:17:01,824 adding 'lm_eval/tasks/global_piqa/parallel_generation/tel_latn.yaml' 2026-09-01T00:17:01,825 adding 'lm_eval/tasks/global_piqa/parallel_generation/tel_telu.yaml' 2026-09-01T00:17:01,826 adding 'lm_eval/tasks/global_piqa/parallel_generation/tgl_latn.yaml' 2026-09-01T00:17:01,827 adding 'lm_eval/tasks/global_piqa/parallel_generation/tha_thai.yaml' 2026-09-01T00:17:01,828 adding 'lm_eval/tasks/global_piqa/parallel_generation/tur_latn.yaml' 2026-09-01T00:17:01,829 adding 'lm_eval/tasks/global_piqa/parallel_generation/uig_arab.yaml' 2026-09-01T00:17:01,830 adding 'lm_eval/tasks/global_piqa/parallel_generation/ukr_cyrl.yaml' 2026-09-01T00:17:01,832 adding 'lm_eval/tasks/global_piqa/parallel_generation/urd_arab.yaml' 2026-09-01T00:17:01,833 adding 'lm_eval/tasks/global_piqa/parallel_generation/urd_latn.yaml' 2026-09-01T00:17:01,834 adding 'lm_eval/tasks/global_piqa/parallel_generation/urh_latn.yaml' 2026-09-01T00:17:01,835 adding 'lm_eval/tasks/global_piqa/parallel_generation/uzn_latn.yaml' 2026-09-01T00:17:01,836 adding 'lm_eval/tasks/global_piqa/parallel_generation/vie_latn.yaml' 2026-09-01T00:17:01,837 adding 'lm_eval/tasks/global_piqa/parallel_generation/xho_latn.yaml' 2026-09-01T00:17:01,838 adding 'lm_eval/tasks/global_piqa/parallel_generation/yor_latn.yaml' 2026-09-01T00:17:01,840 adding 'lm_eval/tasks/global_piqa/parallel_generation/yue_hant.yaml' 2026-09-01T00:17:01,841 adding 'lm_eval/tasks/global_piqa/parallel_generation/zsm_latn.yaml' 2026-09-01T00:17:01,842 adding 'lm_eval/tasks/global_piqa/parallel_generation/zul_latn.yaml' 2026-09-01T00:17:01,844 adding 'lm_eval/tasks/glue/README.md' 2026-09-01T00:17:01,846 adding 'lm_eval/tasks/glue/cola/default.yaml' 2026-09-01T00:17:01,847 adding 'lm_eval/tasks/glue/mnli/default.yaml' 2026-09-01T00:17:01,848 adding 'lm_eval/tasks/glue/mnli/mismatch.yaml' 2026-09-01T00:17:01,850 adding 'lm_eval/tasks/glue/mnli/utils.py' 2026-09-01T00:17:01,851 adding 'lm_eval/tasks/glue/mrpc/default.yaml' 2026-09-01T00:17:01,853 adding 'lm_eval/tasks/glue/qnli/default.yaml' 2026-09-01T00:17:01,855 adding 'lm_eval/tasks/glue/qqp/default.yaml' 2026-09-01T00:17:01,856 adding 'lm_eval/tasks/glue/rte/default.yaml' 2026-09-01T00:17:01,858 adding 'lm_eval/tasks/glue/sst2/default.yaml' 2026-09-01T00:17:01,859 adding 'lm_eval/tasks/glue/wnli/default.yaml' 2026-09-01T00:17:01,861 adding 'lm_eval/tasks/gpqa/README.md' 2026-09-01T00:17:01,863 adding 'lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py' 2026-09-01T00:17:01,864 adding 'lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml' 2026-09-01T00:17:01,865 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml' 2026-09-01T00:17:01,866 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml' 2026-09-01T00:17:01,867 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml' 2026-09-01T00:17:01,868 adding 'lm_eval/tasks/gpqa/cot_n_shot/utils.py' 2026-09-01T00:17:01,870 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py' 2026-09-01T00:17:01,871 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml' 2026-09-01T00:17:01,872 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml' 2026-09-01T00:17:01,873 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml' 2026-09-01T00:17:01,874 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml' 2026-09-01T00:17:01,876 adding 'lm_eval/tasks/gpqa/cot_zeroshot/utils.py' 2026-09-01T00:17:01,877 adding 'lm_eval/tasks/gpqa/generative/_generate_configs.py' 2026-09-01T00:17:01,878 adding 'lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml' 2026-09-01T00:17:01,879 adding 'lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml' 2026-09-01T00:17:01,880 adding 'lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml' 2026-09-01T00:17:01,882 adding 'lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml' 2026-09-01T00:17:01,883 adding 'lm_eval/tasks/gpqa/generative/utils.py' 2026-09-01T00:17:01,884 adding 'lm_eval/tasks/gpqa/n_shot/_generate_configs.py' 2026-09-01T00:17:01,886 adding 'lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml' 2026-09-01T00:17:01,887 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml' 2026-09-01T00:17:01,888 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml' 2026-09-01T00:17:01,889 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml' 2026-09-01T00:17:01,890 adding 'lm_eval/tasks/gpqa/n_shot/utils.py' 2026-09-01T00:17:01,892 adding 'lm_eval/tasks/gpqa/zeroshot/_generate_configs.py' 2026-09-01T00:17:01,893 adding 'lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml' 2026-09-01T00:17:01,894 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml' 2026-09-01T00:17:01,895 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml' 2026-09-01T00:17:01,896 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml' 2026-09-01T00:17:01,898 adding 'lm_eval/tasks/gpqa/zeroshot/utils.py' 2026-09-01T00:17:01,899 adding 'lm_eval/tasks/graphwalks/README.md' 2026-09-01T00:17:01,901 adding 'lm_eval/tasks/graphwalks/graphwalks.yaml' 2026-09-01T00:17:01,902 adding 'lm_eval/tasks/graphwalks/graphwalks_128k.yaml' 2026-09-01T00:17:01,903 adding 'lm_eval/tasks/graphwalks/graphwalks_1M.yaml' 2026-09-01T00:17:01,904 adding 'lm_eval/tasks/graphwalks/utils.py' 2026-09-01T00:17:01,907 adding 'lm_eval/tasks/greekmmlu/README.md' 2026-09-01T00:17:01,908 adding 'lm_eval/tasks/greekmmlu/_default_greekmmlu_template_yaml' 2026-09-01T00:17:01,910 adding 'lm_eval/tasks/greekmmlu/_generate_configs.py' 2026-09-01T00:17:01,911 adding 'lm_eval/tasks/greekmmlu/_greekmmlu.yaml' 2026-09-01T00:17:01,912 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_humanities.yaml' 2026-09-01T00:17:01,913 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_other.yaml' 2026-09-01T00:17:01,915 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_social_sciences.yaml' 2026-09-01T00:17:01,916 adding 'lm_eval/tasks/greekmmlu/_greekmmlu_stem.yaml' 2026-09-01T00:17:01,917 adding 'lm_eval/tasks/greekmmlu/greekmmlu_accounting.yaml' 2026-09-01T00:17:01,918 adding 'lm_eval/tasks/greekmmlu/greekmmlu_agriculture_professional.yaml' 2026-09-01T00:17:01,919 adding 'lm_eval/tasks/greekmmlu/greekmmlu_agriculture_university.yaml' 2026-09-01T00:17:01,920 adding 'lm_eval/tasks/greekmmlu/greekmmlu_art_professional.yaml' 2026-09-01T00:17:01,921 adding 'lm_eval/tasks/greekmmlu/greekmmlu_art_secondary_school.yaml' 2026-09-01T00:17:01,922 adding 'lm_eval/tasks/greekmmlu/greekmmlu_art_university.yaml' 2026-09-01T00:17:01,923 adding 'lm_eval/tasks/greekmmlu/greekmmlu_biology.yaml' 2026-09-01T00:17:01,924 adding 'lm_eval/tasks/greekmmlu/greekmmlu_chemistry.yaml' 2026-09-01T00:17:01,925 adding 'lm_eval/tasks/greekmmlu/greekmmlu_civil_engineering.yaml' 2026-09-01T00:17:01,926 adding 'lm_eval/tasks/greekmmlu/greekmmlu_clinical_knowledge.yaml' 2026-09-01T00:17:01,928 adding 'lm_eval/tasks/greekmmlu/greekmmlu_computer_networks_and_security.yaml' 2026-09-01T00:17:01,929 adding 'lm_eval/tasks/greekmmlu/greekmmlu_computer_science_professional.yaml' 2026-09-01T00:17:01,930 adding 'lm_eval/tasks/greekmmlu/greekmmlu_computer_science_university.yaml' 2026-09-01T00:17:01,931 adding 'lm_eval/tasks/greekmmlu/greekmmlu_driving_rules.yaml' 2026-09-01T00:17:01,932 adding 'lm_eval/tasks/greekmmlu/greekmmlu_economics_professional.yaml' 2026-09-01T00:17:01,933 adding 'lm_eval/tasks/greekmmlu/greekmmlu_economics_university.yaml' 2026-09-01T00:17:01,934 adding 'lm_eval/tasks/greekmmlu/greekmmlu_education_professional.yaml' 2026-09-01T00:17:01,935 adding 'lm_eval/tasks/greekmmlu/greekmmlu_education_university.yaml' 2026-09-01T00:17:01,936 adding 'lm_eval/tasks/greekmmlu/greekmmlu_electrical_engineering.yaml' 2026-09-01T00:17:01,937 adding 'lm_eval/tasks/greekmmlu/greekmmlu_general_knowledge.yaml' 2026-09-01T00:17:01,938 adding 'lm_eval/tasks/greekmmlu/greekmmlu_geography_primary_school.yaml' 2026-09-01T00:17:01,939 adding 'lm_eval/tasks/greekmmlu/greekmmlu_geography_secondary_school.yaml' 2026-09-01T00:17:01,941 adding 'lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_primary_school.yaml' 2026-09-01T00:17:01,942 adding 'lm_eval/tasks/greekmmlu/greekmmlu_government_and_politics_secondary_school.yaml' 2026-09-01T00:17:01,943 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_history_primary_school.yaml' 2026-09-01T00:17:01,944 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_history_professional.yaml' 2026-09-01T00:17:01,945 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_history_secondary_school.yaml' 2026-09-01T00:17:01,946 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_literature.yaml' 2026-09-01T00:17:01,947 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_mythology.yaml' 2026-09-01T00:17:01,948 adding 'lm_eval/tasks/greekmmlu/greekmmlu_greek_traditions.yaml' 2026-09-01T00:17:01,949 adding 'lm_eval/tasks/greekmmlu/greekmmlu_law.yaml' 2026-09-01T00:17:01,951 adding 'lm_eval/tasks/greekmmlu/greekmmlu_management_professional.yaml' 2026-09-01T00:17:01,952 adding 'lm_eval/tasks/greekmmlu/greekmmlu_management_university.yaml' 2026-09-01T00:17:01,953 adding 'lm_eval/tasks/greekmmlu/greekmmlu_maritime_safety_and_rescue_operations.yaml' 2026-09-01T00:17:01,954 adding 'lm_eval/tasks/greekmmlu/greekmmlu_mathematics.yaml' 2026-09-01T00:17:01,955 adding 'lm_eval/tasks/greekmmlu/greekmmlu_medicine_professional.yaml' 2026-09-01T00:17:01,956 adding 'lm_eval/tasks/greekmmlu/greekmmlu_medicine_university.yaml' 2026-09-01T00:17:01,957 adding 'lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_primary_school.yaml' 2026-09-01T00:17:01,959 adding 'lm_eval/tasks/greekmmlu/greekmmlu_modern_greek_language_secondary_school.yaml' 2026-09-01T00:17:01,960 adding 'lm_eval/tasks/greekmmlu/greekmmlu_physics_primary_school.yaml' 2026-09-01T00:17:01,962 adding 'lm_eval/tasks/greekmmlu/greekmmlu_physics_professional.yaml' 2026-09-01T00:17:01,964 adding 'lm_eval/tasks/greekmmlu/greekmmlu_physics_university.yaml' 2026-09-01T00:17:01,965 adding 'lm_eval/tasks/greekmmlu/greekmmlu_prehistory.yaml' 2026-09-01T00:17:01,966 adding 'lm_eval/tasks/greekmmlu/greekmmlu_world_history.yaml' 2026-09-01T00:17:01,967 adding 'lm_eval/tasks/greekmmlu/greekmmlu_world_religions.yaml' 2026-09-01T00:17:01,969 adding 'lm_eval/tasks/greekmmlu/utils.py' 2026-09-01T00:17:01,971 adding 'lm_eval/tasks/groundcocoa/README.md' 2026-09-01T00:17:01,972 adding 'lm_eval/tasks/groundcocoa/groundcocoa.yaml' 2026-09-01T00:17:01,973 adding 'lm_eval/tasks/groundcocoa/utils.py' 2026-09-01T00:17:01,975 adding 'lm_eval/tasks/gsm8k/README.md' 2026-09-01T00:17:01,976 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml' 2026-09-01T00:17:01,977 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml' 2026-09-01T00:17:01,978 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml' 2026-09-01T00:17:01,979 adding 'lm_eval/tasks/gsm8k/gsm8k-cot.yaml' 2026-09-01T00:17:01,981 adding 'lm_eval/tasks/gsm8k/gsm8k.yaml' 2026-09-01T00:17:01,982 adding 'lm_eval/tasks/gsm8k_platinum/README.md' 2026-09-01T00:17:01,984 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-llama.yaml' 2026-09-01T00:17:01,985 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-self-consistency.yaml' 2026-09-01T00:17:01,986 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot-zeroshot.yaml' 2026-09-01T00:17:01,988 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum-cot.yaml' 2026-09-01T00:17:01,989 adding 'lm_eval/tasks/gsm8k_platinum/gsm8k-platinum.yaml' 2026-09-01T00:17:01,991 adding 'lm_eval/tasks/gsm_plus/README.md' 2026-09-01T00:17:01,992 adding 'lm_eval/tasks/gsm_plus/gsm_plus.yaml' 2026-09-01T00:17:01,993 adding 'lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml' 2026-09-01T00:17:01,995 adding 'lm_eval/tasks/haerae/README.md' 2026-09-01T00:17:01,996 adding 'lm_eval/tasks/haerae/_default_haerae_yaml' 2026-09-01T00:17:01,997 adding 'lm_eval/tasks/haerae/_haerae.yaml' 2026-09-01T00:17:01,998 adding 'lm_eval/tasks/haerae/haerae_gk.yaml' 2026-09-01T00:17:02,000 adding 'lm_eval/tasks/haerae/haerae_hi.yaml' 2026-09-01T00:17:02,001 adding 'lm_eval/tasks/haerae/haerae_lw.yaml' 2026-09-01T00:17:02,002 adding 'lm_eval/tasks/haerae/haerae_rw.yaml' 2026-09-01T00:17:02,003 adding 'lm_eval/tasks/haerae/haerae_sn.yaml' 2026-09-01T00:17:02,005 adding 'lm_eval/tasks/headqa/README.md' 2026-09-01T00:17:02,006 adding 'lm_eval/tasks/headqa/headqa_en.yaml' 2026-09-01T00:17:02,007 adding 'lm_eval/tasks/headqa/headqa_es.yaml' 2026-09-01T00:17:02,009 adding 'lm_eval/tasks/hellaswag/README.md' 2026-09-01T00:17:02,010 adding 'lm_eval/tasks/hellaswag/hellaswag.yaml' 2026-09-01T00:17:02,011 adding 'lm_eval/tasks/hellaswag/utils.py' 2026-09-01T00:17:02,013 adding 'lm_eval/tasks/hendrycks_ethics/README.md' 2026-09-01T00:17:02,014 adding 'lm_eval/tasks/hendrycks_ethics/commonsense.yaml' 2026-09-01T00:17:02,015 adding 'lm_eval/tasks/hendrycks_ethics/deontology.yaml' 2026-09-01T00:17:02,016 adding 'lm_eval/tasks/hendrycks_ethics/justice.yaml' 2026-09-01T00:17:02,017 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml' 2026-09-01T00:17:02,019 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml' 2026-09-01T00:17:02,020 adding 'lm_eval/tasks/hendrycks_ethics/utils.py' 2026-09-01T00:17:02,021 adding 'lm_eval/tasks/hendrycks_ethics/virtue.yaml' 2026-09-01T00:17:02,023 adding 'lm_eval/tasks/hendrycks_math/README.md' 2026-09-01T00:17:02,024 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math.yaml' 2026-09-01T00:17:02,025 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math500.yaml' 2026-09-01T00:17:02,026 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml' 2026-09-01T00:17:02,028 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml' 2026-09-01T00:17:02,029 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml' 2026-09-01T00:17:02,030 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml' 2026-09-01T00:17:02,031 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml' 2026-09-01T00:17:02,032 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml' 2026-09-01T00:17:02,033 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml' 2026-09-01T00:17:02,035 adding 'lm_eval/tasks/hendrycks_math/utils.py' 2026-09-01T00:17:02,037 adding 'lm_eval/tasks/histoires_morales/README.md' 2026-09-01T00:17:02,038 adding 'lm_eval/tasks/histoires_morales/histoires_morales.yaml' 2026-09-01T00:17:02,039 adding 'lm_eval/tasks/histoires_morales/utils.py' 2026-09-01T00:17:02,041 adding 'lm_eval/tasks/hrm8k/README.md' 2026-09-01T00:17:02,042 adding 'lm_eval/tasks/hrm8k/default/_hrm8k_yaml' 2026-09-01T00:17:02,043 adding 'lm_eval/tasks/hrm8k/default/hrm8k.yaml' 2026-09-01T00:17:02,044 adding 'lm_eval/tasks/hrm8k/default/hrm8k_gsm8k.yaml' 2026-09-01T00:17:02,046 adding 'lm_eval/tasks/hrm8k/default/hrm8k_ksm.yaml' 2026-09-01T00:17:02,047 adding 'lm_eval/tasks/hrm8k/default/hrm8k_math.yaml' 2026-09-01T00:17:02,048 adding 'lm_eval/tasks/hrm8k/default/hrm8k_mmmlu.yaml' 2026-09-01T00:17:02,049 adding 'lm_eval/tasks/hrm8k/default/hrm8k_omni_math.yaml' 2026-09-01T00:17:02,050 adding 'lm_eval/tasks/hrm8k/default/utils.py' 2026-09-01T00:17:02,052 adding 'lm_eval/tasks/hrm8k/en/_hrm8k_en_yaml' 2026-09-01T00:17:02,053 adding 'lm_eval/tasks/hrm8k/en/hrm8k_en.yaml' 2026-09-01T00:17:02,054 adding 'lm_eval/tasks/hrm8k/en/hrm8k_gsm8k_en.yaml' 2026-09-01T00:17:02,055 adding 'lm_eval/tasks/hrm8k/en/hrm8k_ksm_en.yaml' 2026-09-01T00:17:02,057 adding 'lm_eval/tasks/hrm8k/en/hrm8k_math_en.yaml' 2026-09-01T00:17:02,058 adding 'lm_eval/tasks/hrm8k/en/hrm8k_mmmlu_en.yaml' 2026-09-01T00:17:02,059 adding 'lm_eval/tasks/hrm8k/en/hrm8k_omni_math_en.yaml' 2026-09-01T00:17:02,060 adding 'lm_eval/tasks/hrm8k/en/utils.py' 2026-09-01T00:17:02,062 adding 'lm_eval/tasks/humaneval/README.md' 2026-09-01T00:17:02,063 adding 'lm_eval/tasks/humaneval/humaneval.yaml' 2026-09-01T00:17:02,065 adding 'lm_eval/tasks/humaneval/humaneval_64.yaml' 2026-09-01T00:17:02,066 adding 'lm_eval/tasks/humaneval/humaneval_64_instruct.yaml' 2026-09-01T00:17:02,067 adding 'lm_eval/tasks/humaneval/humaneval_instruct.yaml' 2026-09-01T00:17:02,068 adding 'lm_eval/tasks/humaneval/humaneval_plus.yaml' 2026-09-01T00:17:02,069 adding 'lm_eval/tasks/humaneval/utils.py' 2026-09-01T00:17:02,071 adding 'lm_eval/tasks/humaneval_infilling/README.md' 2026-09-01T00:17:02,072 adding 'lm_eval/tasks/humaneval_infilling/humaneval_infilling.yaml' 2026-09-01T00:17:02,074 adding 'lm_eval/tasks/humaneval_infilling/multi_line_infilling.yaml' 2026-09-01T00:17:02,075 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling.yaml' 2026-09-01T00:17:02,076 adding 'lm_eval/tasks/humaneval_infilling/random_span_infilling_light.yaml' 2026-09-01T00:17:02,077 adding 'lm_eval/tasks/humaneval_infilling/single_line_infilling.yaml' 2026-09-01T00:17:02,078 adding 'lm_eval/tasks/humaneval_infilling/utils.py' 2026-09-01T00:17:02,080 adding 'lm_eval/tasks/icelandic_winogrande/README.md' 2026-09-01T00:17:02,081 adding 'lm_eval/tasks/icelandic_winogrande/default.yaml' 2026-09-01T00:17:02,083 adding 'lm_eval/tasks/icelandic_winogrande/preprocess_winogrande.py' 2026-09-01T00:17:02,085 adding 'lm_eval/tasks/ifeval/README.md' 2026-09-01T00:17:02,086 adding 'lm_eval/tasks/ifeval/ifeval.yaml' 2026-09-01T00:17:02,091 adding 'lm_eval/tasks/ifeval/instructions.py' 2026-09-01T00:17:02,093 adding 'lm_eval/tasks/ifeval/instructions_registry.py' 2026-09-01T00:17:02,096 adding 'lm_eval/tasks/ifeval/instructions_util.py' 2026-09-01T00:17:02,098 adding 'lm_eval/tasks/ifeval/utils.py' 2026-09-01T00:17:02,100 adding 'lm_eval/tasks/ifeval/multilingual/ifeval_ca.yaml' 2026-09-01T00:17:02,101 adding 'lm_eval/tasks/ifeval/multilingual/ifeval_es.yaml' 2026-09-01T00:17:02,102 adding 'lm_eval/tasks/ifeval/multilingual/instructions_registry.py' 2026-09-01T00:17:02,104 adding 'lm_eval/tasks/ifeval/multilingual/utils.py' 2026-09-01T00:17:02,106 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/__init__.py' 2026-09-01T00:17:02,107 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/ca_instructions_util.py' 2026-09-01T00:17:02,109 adding 'lm_eval/tasks/ifeval/multilingual/instruction_utils/es_instructions_util.py' 2026-09-01T00:17:02,110 adding 'lm_eval/tasks/ifeval/multilingual/instructions/__init__.py' 2026-09-01T00:17:02,117 adding 'lm_eval/tasks/ifeval/multilingual/instructions/ca_instructions.py' 2026-09-01T00:17:02,123 adding 'lm_eval/tasks/ifeval/multilingual/instructions/es_instructions.py' 2026-09-01T00:17:02,125 adding 'lm_eval/tasks/include/README.md' 2026-09-01T00:17:02,128 adding 'lm_eval/tasks/include/default/Albanian/_albanian_template_yaml' 2026-09-01T00:17:02,129 adding 'lm_eval/tasks/include/default/Albanian/_include_base_44_albanian.yaml' 2026-09-01T00:17:02,130 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-09-01T00:17:02,131 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-09-01T00:17:02,132 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-09-01T00:17:02,133 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_social_science.yaml' 2026-09-01T00:17:02,135 adding 'lm_eval/tasks/include/default/Albanian/include_base_44_albanian_stem.yaml' 2026-09-01T00:17:02,136 adding 'lm_eval/tasks/include/default/Albanian/utils.py' 2026-09-01T00:17:02,138 adding 'lm_eval/tasks/include/default/Arabic/_arabic_template_yaml' 2026-09-01T00:17:02,139 adding 'lm_eval/tasks/include/default/Arabic/_include_base_44_arabic.yaml' 2026-09-01T00:17:02,140 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-09-01T00:17:02,141 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-09-01T00:17:02,142 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_driving_license.yaml' 2026-09-01T00:17:02,143 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-09-01T00:17:02,144 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_social_science.yaml' 2026-09-01T00:17:02,146 adding 'lm_eval/tasks/include/default/Arabic/include_base_44_arabic_stem.yaml' 2026-09-01T00:17:02,147 adding 'lm_eval/tasks/include/default/Arabic/utils.py' 2026-09-01T00:17:02,149 adding 'lm_eval/tasks/include/default/Armenian/_armenian_template_yaml' 2026-09-01T00:17:02,150 adding 'lm_eval/tasks/include/default/Armenian/_include_base_44_armenian.yaml' 2026-09-01T00:17:02,151 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-09-01T00:17:02,153 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_driving_license.yaml' 2026-09-01T00:17:02,154 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_social_science.yaml' 2026-09-01T00:17:02,155 adding 'lm_eval/tasks/include/default/Armenian/include_base_44_armenian_stem.yaml' 2026-09-01T00:17:02,157 adding 'lm_eval/tasks/include/default/Armenian/utils.py' 2026-09-01T00:17:02,159 adding 'lm_eval/tasks/include/default/Azerbaijani/_azerbaijani_template_yaml' 2026-09-01T00:17:02,160 adding 'lm_eval/tasks/include/default/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-09-01T00:17:02,162 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-09-01T00:17:02,163 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-09-01T00:17:02,164 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-09-01T00:17:02,165 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-09-01T00:17:02,167 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-09-01T00:17:02,168 adding 'lm_eval/tasks/include/default/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-09-01T00:17:02,169 adding 'lm_eval/tasks/include/default/Azerbaijani/utils.py' 2026-09-01T00:17:02,171 adding 'lm_eval/tasks/include/default/Basque/_basque_template_yaml' 2026-09-01T00:17:02,172 adding 'lm_eval/tasks/include/default/Basque/_include_base_44_basque.yaml' 2026-09-01T00:17:02,173 adding 'lm_eval/tasks/include/default/Basque/include_base_44_basque_professional_certification.yaml' 2026-09-01T00:17:02,174 adding 'lm_eval/tasks/include/default/Basque/utils.py' 2026-09-01T00:17:02,176 adding 'lm_eval/tasks/include/default/Belarusian/_belarusian_template_yaml' 2026-09-01T00:17:02,177 adding 'lm_eval/tasks/include/default/Belarusian/_include_base_44_belarusian.yaml' 2026-09-01T00:17:02,178 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-09-01T00:17:02,179 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-09-01T00:17:02,180 adding 'lm_eval/tasks/include/default/Belarusian/include_base_44_belarusian_stem.yaml' 2026-09-01T00:17:02,181 adding 'lm_eval/tasks/include/default/Belarusian/utils.py' 2026-09-01T00:17:02,183 adding 'lm_eval/tasks/include/default/Bengali/_bengali_template_yaml' 2026-09-01T00:17:02,184 adding 'lm_eval/tasks/include/default/Bengali/_include_base_44_bengali.yaml' 2026-09-01T00:17:02,185 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-09-01T00:17:02,186 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-09-01T00:17:02,187 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-09-01T00:17:02,188 adding 'lm_eval/tasks/include/default/Bengali/include_base_44_bengali_stem.yaml' 2026-09-01T00:17:02,190 adding 'lm_eval/tasks/include/default/Bengali/utils.py' 2026-09-01T00:17:02,191 adding 'lm_eval/tasks/include/default/Bulgarian/_bulgarian_template_yaml' 2026-09-01T00:17:02,192 adding 'lm_eval/tasks/include/default/Bulgarian/_include_base_44_bulgarian.yaml' 2026-09-01T00:17:02,194 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-09-01T00:17:02,195 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-09-01T00:17:02,196 adding 'lm_eval/tasks/include/default/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-09-01T00:17:02,197 adding 'lm_eval/tasks/include/default/Bulgarian/utils.py' 2026-09-01T00:17:02,199 adding 'lm_eval/tasks/include/default/Chinese/_chinese_template_yaml' 2026-09-01T00:17:02,200 adding 'lm_eval/tasks/include/default/Chinese/_include_base_44_chinese.yaml' 2026-09-01T00:17:02,201 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_applied_science.yaml' 2026-09-01T00:17:02,202 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-09-01T00:17:02,203 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-09-01T00:17:02,204 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_driving_license.yaml' 2026-09-01T00:17:02,206 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-09-01T00:17:02,207 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-09-01T00:17:02,208 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_social_science.yaml' 2026-09-01T00:17:02,209 adding 'lm_eval/tasks/include/default/Chinese/include_base_44_chinese_stem.yaml' 2026-09-01T00:17:02,210 adding 'lm_eval/tasks/include/default/Chinese/utils.py' 2026-09-01T00:17:02,212 adding 'lm_eval/tasks/include/default/Croatian/_croatian_template_yaml' 2026-09-01T00:17:02,213 adding 'lm_eval/tasks/include/default/Croatian/_include_base_44_croatian.yaml' 2026-09-01T00:17:02,214 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-09-01T00:17:02,215 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_social_science.yaml' 2026-09-01T00:17:02,217 adding 'lm_eval/tasks/include/default/Croatian/include_base_44_croatian_stem.yaml' 2026-09-01T00:17:02,218 adding 'lm_eval/tasks/include/default/Croatian/utils.py' 2026-09-01T00:17:02,220 adding 'lm_eval/tasks/include/default/Dutch/_dutch_template_yaml' 2026-09-01T00:17:02,221 adding 'lm_eval/tasks/include/default/Dutch/_include_base_44_dutch.yaml' 2026-09-01T00:17:02,222 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_applied_science.yaml' 2026-09-01T00:17:02,223 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-09-01T00:17:02,224 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-09-01T00:17:02,225 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_social_science.yaml' 2026-09-01T00:17:02,226 adding 'lm_eval/tasks/include/default/Dutch/include_base_44_dutch_stem.yaml' 2026-09-01T00:17:02,227 adding 'lm_eval/tasks/include/default/Dutch/utils.py' 2026-09-01T00:17:02,229 adding 'lm_eval/tasks/include/default/Estonian/_estonian_template_yaml' 2026-09-01T00:17:02,230 adding 'lm_eval/tasks/include/default/Estonian/_include_base_44_estonian.yaml' 2026-09-01T00:17:02,231 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_applied_science.yaml' 2026-09-01T00:17:02,233 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-09-01T00:17:02,234 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-09-01T00:17:02,235 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_social_science.yaml' 2026-09-01T00:17:02,236 adding 'lm_eval/tasks/include/default/Estonian/include_base_44_estonian_stem.yaml' 2026-09-01T00:17:02,237 adding 'lm_eval/tasks/include/default/Estonian/utils.py' 2026-09-01T00:17:02,239 adding 'lm_eval/tasks/include/default/Finnish/_finnish_template_yaml' 2026-09-01T00:17:02,240 adding 'lm_eval/tasks/include/default/Finnish/_include_base_44_finnish.yaml' 2026-09-01T00:17:02,241 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_applied_science.yaml' 2026-09-01T00:17:02,242 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-09-01T00:17:02,243 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-09-01T00:17:02,245 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_social_science.yaml' 2026-09-01T00:17:02,246 adding 'lm_eval/tasks/include/default/Finnish/include_base_44_finnish_stem.yaml' 2026-09-01T00:17:02,247 adding 'lm_eval/tasks/include/default/Finnish/utils.py' 2026-09-01T00:17:02,249 adding 'lm_eval/tasks/include/default/French/_french_template_yaml' 2026-09-01T00:17:02,250 adding 'lm_eval/tasks/include/default/French/_include_base_44_french.yaml' 2026-09-01T00:17:02,251 adding 'lm_eval/tasks/include/default/French/include_base_44_french_arts_humanities.yaml' 2026-09-01T00:17:02,252 adding 'lm_eval/tasks/include/default/French/include_base_44_french_driving_license.yaml' 2026-09-01T00:17:02,253 adding 'lm_eval/tasks/include/default/French/include_base_44_french_health_oriented_education.yaml' 2026-09-01T00:17:02,255 adding 'lm_eval/tasks/include/default/French/include_base_44_french_social_science.yaml' 2026-09-01T00:17:02,256 adding 'lm_eval/tasks/include/default/French/include_base_44_french_stem.yaml' 2026-09-01T00:17:02,257 adding 'lm_eval/tasks/include/default/French/utils.py' 2026-09-01T00:17:02,259 adding 'lm_eval/tasks/include/default/Georgian/_georgian_template_yaml' 2026-09-01T00:17:02,260 adding 'lm_eval/tasks/include/default/Georgian/_include_base_44_georgian.yaml' 2026-09-01T00:17:02,261 adding 'lm_eval/tasks/include/default/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-09-01T00:17:02,262 adding 'lm_eval/tasks/include/default/Georgian/utils.py' 2026-09-01T00:17:02,264 adding 'lm_eval/tasks/include/default/German/_german_template_yaml' 2026-09-01T00:17:02,266 adding 'lm_eval/tasks/include/default/German/_include_base_44_german.yaml' 2026-09-01T00:17:02,267 adding 'lm_eval/tasks/include/default/German/include_base_44_german_driving_license.yaml' 2026-09-01T00:17:02,268 adding 'lm_eval/tasks/include/default/German/include_base_44_german_social_science.yaml' 2026-09-01T00:17:02,269 adding 'lm_eval/tasks/include/default/German/include_base_44_german_stem.yaml' 2026-09-01T00:17:02,270 adding 'lm_eval/tasks/include/default/German/utils.py' 2026-09-01T00:17:02,272 adding 'lm_eval/tasks/include/default/Greek/_greek_template_yaml' 2026-09-01T00:17:02,273 adding 'lm_eval/tasks/include/default/Greek/_include_base_44_greek.yaml' 2026-09-01T00:17:02,274 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_arts_humanities.yaml' 2026-09-01T00:17:02,275 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_business_commerce.yaml' 2026-09-01T00:17:02,276 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-09-01T00:17:02,277 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_medical_license.yaml' 2026-09-01T00:17:02,278 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_professional_certification.yaml' 2026-09-01T00:17:02,279 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_social_science.yaml' 2026-09-01T00:17:02,280 adding 'lm_eval/tasks/include/default/Greek/include_base_44_greek_stem.yaml' 2026-09-01T00:17:02,282 adding 'lm_eval/tasks/include/default/Greek/utils.py' 2026-09-01T00:17:02,283 adding 'lm_eval/tasks/include/default/Hebrew/_hebrew_template_yaml' 2026-09-01T00:17:02,284 adding 'lm_eval/tasks/include/default/Hebrew/_include_base_44_hebrew.yaml' 2026-09-01T00:17:02,286 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-09-01T00:17:02,287 adding 'lm_eval/tasks/include/default/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-09-01T00:17:02,288 adding 'lm_eval/tasks/include/default/Hebrew/utils.py' 2026-09-01T00:17:02,290 adding 'lm_eval/tasks/include/default/Hindi/_hindi_template_yaml' 2026-09-01T00:17:02,291 adding 'lm_eval/tasks/include/default/Hindi/_include_base_44_hindi.yaml' 2026-09-01T00:17:02,292 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_applied_science.yaml' 2026-09-01T00:17:02,293 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-09-01T00:17:02,294 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_driving_license.yaml' 2026-09-01T00:17:02,296 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-09-01T00:17:02,297 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-09-01T00:17:02,298 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-09-01T00:17:02,299 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_social_science.yaml' 2026-09-01T00:17:02,300 adding 'lm_eval/tasks/include/default/Hindi/include_base_44_hindi_stem.yaml' 2026-09-01T00:17:02,301 adding 'lm_eval/tasks/include/default/Hindi/utils.py' 2026-09-01T00:17:02,303 adding 'lm_eval/tasks/include/default/Hungarian/_hungarian_template_yaml' 2026-09-01T00:17:02,304 adding 'lm_eval/tasks/include/default/Hungarian/_include_base_44_hungarian.yaml' 2026-09-01T00:17:02,306 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-09-01T00:17:02,307 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-09-01T00:17:02,308 adding 'lm_eval/tasks/include/default/Hungarian/include_base_44_hungarian_stem.yaml' 2026-09-01T00:17:02,309 adding 'lm_eval/tasks/include/default/Hungarian/utils.py' 2026-09-01T00:17:02,311 adding 'lm_eval/tasks/include/default/Indonesian/_include_base_44_indonesian.yaml' 2026-09-01T00:17:02,312 adding 'lm_eval/tasks/include/default/Indonesian/_indonesian_template_yaml' 2026-09-01T00:17:02,313 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-09-01T00:17:02,315 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-09-01T00:17:02,316 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-09-01T00:17:02,317 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-09-01T00:17:02,318 adding 'lm_eval/tasks/include/default/Indonesian/include_base_44_indonesian_stem.yaml' 2026-09-01T00:17:02,319 adding 'lm_eval/tasks/include/default/Indonesian/utils.py' 2026-09-01T00:17:02,320 adding 'lm_eval/tasks/include/default/Italian/_include_base_44_italian.yaml' 2026-09-01T00:17:02,322 adding 'lm_eval/tasks/include/default/Italian/_italian_template_yaml' 2026-09-01T00:17:02,323 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_applied_science.yaml' 2026-09-01T00:17:02,326 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_arts_humanities.yaml' 2026-09-01T00:17:02,327 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-09-01T00:17:02,328 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_professional_certification.yaml' 2026-09-01T00:17:02,330 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_social_science.yaml' 2026-09-01T00:17:02,331 adding 'lm_eval/tasks/include/default/Italian/include_base_44_italian_stem.yaml' 2026-09-01T00:17:02,332 adding 'lm_eval/tasks/include/default/Italian/utils.py' 2026-09-01T00:17:02,334 adding 'lm_eval/tasks/include/default/Japanese/_include_base_44_japanese.yaml' 2026-09-01T00:17:02,335 adding 'lm_eval/tasks/include/default/Japanese/_japanese_template_yaml' 2026-09-01T00:17:02,336 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_driving_license.yaml' 2026-09-01T00:17:02,337 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_medical_license.yaml' 2026-09-01T00:17:02,338 adding 'lm_eval/tasks/include/default/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-09-01T00:17:02,339 adding 'lm_eval/tasks/include/default/Japanese/utils.py' 2026-09-01T00:17:02,341 adding 'lm_eval/tasks/include/default/Kazakh/_include_base_44_kazakh.yaml' 2026-09-01T00:17:02,342 adding 'lm_eval/tasks/include/default/Kazakh/_kazakh_template_yaml' 2026-09-01T00:17:02,343 adding 'lm_eval/tasks/include/default/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-09-01T00:17:02,345 adding 'lm_eval/tasks/include/default/Kazakh/utils.py' 2026-09-01T00:17:02,346 adding 'lm_eval/tasks/include/default/Korean/_include_base_44_korean.yaml' 2026-09-01T00:17:02,348 adding 'lm_eval/tasks/include/default/Korean/_korean_template_yaml' 2026-09-01T00:17:02,349 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_professional_certification.yaml' 2026-09-01T00:17:02,350 adding 'lm_eval/tasks/include/default/Korean/include_base_44_korean_social_science.yaml' 2026-09-01T00:17:02,351 adding 'lm_eval/tasks/include/default/Korean/utils.py' 2026-09-01T00:17:02,353 adding 'lm_eval/tasks/include/default/Lithuanian/_include_base_44_lithuanian.yaml' 2026-09-01T00:17:02,354 adding 'lm_eval/tasks/include/default/Lithuanian/_lithuanian_template_yaml' 2026-09-01T00:17:02,355 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-09-01T00:17:02,357 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-09-01T00:17:02,358 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-09-01T00:17:02,359 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-09-01T00:17:02,360 adding 'lm_eval/tasks/include/default/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-09-01T00:17:02,361 adding 'lm_eval/tasks/include/default/Lithuanian/utils.py' 2026-09-01T00:17:02,363 adding 'lm_eval/tasks/include/default/Malay/_include_base_44_malay.yaml' 2026-09-01T00:17:02,364 adding 'lm_eval/tasks/include/default/Malay/_malay_template_yaml' 2026-09-01T00:17:02,365 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_arts_humanities.yaml' 2026-09-01T00:17:02,366 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_business_commerce.yaml' 2026-09-01T00:17:02,367 adding 'lm_eval/tasks/include/default/Malay/include_base_44_malay_social_science.yaml' 2026-09-01T00:17:02,368 adding 'lm_eval/tasks/include/default/Malay/utils.py' 2026-09-01T00:17:02,370 adding 'lm_eval/tasks/include/default/Malayalam/_include_base_44_malayalam.yaml' 2026-09-01T00:17:02,371 adding 'lm_eval/tasks/include/default/Malayalam/_malayalam_template_yaml' 2026-09-01T00:17:02,372 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-09-01T00:17:02,373 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-09-01T00:17:02,374 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-09-01T00:17:02,375 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-09-01T00:17:02,377 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-09-01T00:17:02,378 adding 'lm_eval/tasks/include/default/Malayalam/include_base_44_malayalam_stem.yaml' 2026-09-01T00:17:02,379 adding 'lm_eval/tasks/include/default/Malayalam/utils.py' 2026-09-01T00:17:02,381 adding 'lm_eval/tasks/include/default/Nepali/_include_base_44_nepali.yaml' 2026-09-01T00:17:02,382 adding 'lm_eval/tasks/include/default/Nepali/_nepali_template_yaml' 2026-09-01T00:17:02,383 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_driving_license.yaml' 2026-09-01T00:17:02,384 adding 'lm_eval/tasks/include/default/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-09-01T00:17:02,385 adding 'lm_eval/tasks/include/default/Nepali/utils.py' 2026-09-01T00:17:02,387 adding 'lm_eval/tasks/include/default/North Macedonian/_include_base_44_north_macedonian.yaml' 2026-09-01T00:17:02,388 adding 'lm_eval/tasks/include/default/North Macedonian/_north_macedonian_template_yaml' 2026-09-01T00:17:02,390 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml' 2026-09-01T00:17:02,391 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml' 2026-09-01T00:17:02,392 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_social_science.yaml' 2026-09-01T00:17:02,393 adding 'lm_eval/tasks/include/default/North Macedonian/include_base_44_north_macedonian_stem.yaml' 2026-09-01T00:17:02,394 adding 'lm_eval/tasks/include/default/North Macedonian/utils.py' 2026-09-01T00:17:02,396 adding 'lm_eval/tasks/include/default/Persian/_include_base_44_persian.yaml' 2026-09-01T00:17:02,397 adding 'lm_eval/tasks/include/default/Persian/_persian_template_yaml' 2026-09-01T00:17:02,398 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_arts_humanities.yaml' 2026-09-01T00:17:02,400 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_driving_license.yaml' 2026-09-01T00:17:02,401 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_professional_certification.yaml' 2026-09-01T00:17:02,402 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_social_science.yaml' 2026-09-01T00:17:02,403 adding 'lm_eval/tasks/include/default/Persian/include_base_44_persian_stem.yaml' 2026-09-01T00:17:02,404 adding 'lm_eval/tasks/include/default/Persian/utils.py' 2026-09-01T00:17:02,406 adding 'lm_eval/tasks/include/default/Polish/_include_base_44_polish.yaml' 2026-09-01T00:17:02,407 adding 'lm_eval/tasks/include/default/Polish/_polish_template_yaml' 2026-09-01T00:17:02,408 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_professional_certification.yaml' 2026-09-01T00:17:02,409 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_social_science.yaml' 2026-09-01T00:17:02,410 adding 'lm_eval/tasks/include/default/Polish/include_base_44_polish_stem.yaml' 2026-09-01T00:17:02,411 adding 'lm_eval/tasks/include/default/Polish/utils.py' 2026-09-01T00:17:02,413 adding 'lm_eval/tasks/include/default/Portuguese/_include_base_44_portuguese.yaml' 2026-09-01T00:17:02,414 adding 'lm_eval/tasks/include/default/Portuguese/_portuguese_template_yaml' 2026-09-01T00:17:02,415 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-09-01T00:17:02,416 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-09-01T00:17:02,418 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-09-01T00:17:02,419 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-09-01T00:17:02,420 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-09-01T00:17:02,421 adding 'lm_eval/tasks/include/default/Portuguese/include_base_44_portuguese_stem.yaml' 2026-09-01T00:17:02,422 adding 'lm_eval/tasks/include/default/Portuguese/utils.py' 2026-09-01T00:17:02,424 adding 'lm_eval/tasks/include/default/Russian/_include_base_44_russian.yaml' 2026-09-01T00:17:02,425 adding 'lm_eval/tasks/include/default/Russian/_russian_template_yaml' 2026-09-01T00:17:02,426 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_applied_science.yaml' 2026-09-01T00:17:02,427 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_arts_humanities.yaml' 2026-09-01T00:17:02,428 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_business_commerce.yaml' 2026-09-01T00:17:02,430 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_driving_license.yaml' 2026-09-01T00:17:02,431 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-09-01T00:17:02,432 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_marine_license.yaml' 2026-09-01T00:17:02,433 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_social_science.yaml' 2026-09-01T00:17:02,434 adding 'lm_eval/tasks/include/default/Russian/include_base_44_russian_stem.yaml' 2026-09-01T00:17:02,435 adding 'lm_eval/tasks/include/default/Russian/utils.py' 2026-09-01T00:17:02,437 adding 'lm_eval/tasks/include/default/Serbian/_include_base_44_serbian.yaml' 2026-09-01T00:17:02,438 adding 'lm_eval/tasks/include/default/Serbian/_serbian_template_yaml' 2026-09-01T00:17:02,439 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-09-01T00:17:02,441 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_social_science.yaml' 2026-09-01T00:17:02,442 adding 'lm_eval/tasks/include/default/Serbian/include_base_44_serbian_stem.yaml' 2026-09-01T00:17:02,443 adding 'lm_eval/tasks/include/default/Serbian/utils.py' 2026-09-01T00:17:02,445 adding 'lm_eval/tasks/include/default/Spanish/_include_base_44_spanish.yaml' 2026-09-01T00:17:02,446 adding 'lm_eval/tasks/include/default/Spanish/_spanish_template_yaml' 2026-09-01T00:17:02,447 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-09-01T00:17:02,448 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-09-01T00:17:02,449 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_social_science.yaml' 2026-09-01T00:17:02,451 adding 'lm_eval/tasks/include/default/Spanish/include_base_44_spanish_stem.yaml' 2026-09-01T00:17:02,452 adding 'lm_eval/tasks/include/default/Spanish/utils.py' 2026-09-01T00:17:02,453 adding 'lm_eval/tasks/include/default/Tagalog/_include_base_44_tagalog.yaml' 2026-09-01T00:17:02,455 adding 'lm_eval/tasks/include/default/Tagalog/_tagalog_template_yaml' 2026-09-01T00:17:02,456 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-09-01T00:17:02,457 adding 'lm_eval/tasks/include/default/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-09-01T00:17:02,458 adding 'lm_eval/tasks/include/default/Tagalog/utils.py' 2026-09-01T00:17:02,459 adding 'lm_eval/tasks/include/default/Tamil/_include_base_44_tamil.yaml' 2026-09-01T00:17:02,461 adding 'lm_eval/tasks/include/default/Tamil/_tamil_template_yaml' 2026-09-01T00:17:02,462 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-09-01T00:17:02,463 adding 'lm_eval/tasks/include/default/Tamil/include_base_44_tamil_stem.yaml' 2026-09-01T00:17:02,464 adding 'lm_eval/tasks/include/default/Tamil/utils.py' 2026-09-01T00:17:02,466 adding 'lm_eval/tasks/include/default/Telugu/_include_base_44_telugu.yaml' 2026-09-01T00:17:02,467 adding 'lm_eval/tasks/include/default/Telugu/_telugu_template_yaml' 2026-09-01T00:17:02,468 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_applied_science.yaml' 2026-09-01T00:17:02,469 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-09-01T00:17:02,470 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_social_science.yaml' 2026-09-01T00:17:02,472 adding 'lm_eval/tasks/include/default/Telugu/include_base_44_telugu_stem.yaml' 2026-09-01T00:17:02,473 adding 'lm_eval/tasks/include/default/Telugu/utils.py' 2026-09-01T00:17:02,475 adding 'lm_eval/tasks/include/default/Turkish/_include_base_44_turkish.yaml' 2026-09-01T00:17:02,476 adding 'lm_eval/tasks/include/default/Turkish/_turkish_template_yaml' 2026-09-01T00:17:02,477 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-09-01T00:17:02,478 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-09-01T00:17:02,479 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_social_science.yaml' 2026-09-01T00:17:02,480 adding 'lm_eval/tasks/include/default/Turkish/include_base_44_turkish_stem.yaml' 2026-09-01T00:17:02,481 adding 'lm_eval/tasks/include/default/Turkish/utils.py' 2026-09-01T00:17:02,483 adding 'lm_eval/tasks/include/default/Ukrainian/_include_base_44_ukrainian.yaml' 2026-09-01T00:17:02,484 adding 'lm_eval/tasks/include/default/Ukrainian/_ukrainian_template_yaml' 2026-09-01T00:17:02,486 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-09-01T00:17:02,487 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-09-01T00:17:02,488 adding 'lm_eval/tasks/include/default/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-09-01T00:17:02,489 adding 'lm_eval/tasks/include/default/Ukrainian/utils.py' 2026-09-01T00:17:02,491 adding 'lm_eval/tasks/include/default/Urdu/_include_base_44_urdu.yaml' 2026-09-01T00:17:02,492 adding 'lm_eval/tasks/include/default/Urdu/_urdu_template_yaml' 2026-09-01T00:17:02,493 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-09-01T00:17:02,494 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-09-01T00:17:02,496 adding 'lm_eval/tasks/include/default/Urdu/include_base_44_urdu_stem.yaml' 2026-09-01T00:17:02,497 adding 'lm_eval/tasks/include/default/Urdu/utils.py' 2026-09-01T00:17:02,499 adding 'lm_eval/tasks/include/default/Uzbek/_include_base_44_uzbek.yaml' 2026-09-01T00:17:02,500 adding 'lm_eval/tasks/include/default/Uzbek/_uzbek_template_yaml' 2026-09-01T00:17:02,501 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-09-01T00:17:02,502 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-09-01T00:17:02,503 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-09-01T00:17:02,504 adding 'lm_eval/tasks/include/default/Uzbek/include_base_44_uzbek_stem.yaml' 2026-09-01T00:17:02,505 adding 'lm_eval/tasks/include/default/Uzbek/utils.py' 2026-09-01T00:17:02,507 adding 'lm_eval/tasks/include/default/Vietnamese/_include_base_44_vietnamese.yaml' 2026-09-01T00:17:02,508 adding 'lm_eval/tasks/include/default/Vietnamese/_vietnamese_template_yaml' 2026-09-01T00:17:02,509 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-09-01T00:17:02,510 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-09-01T00:17:02,511 adding 'lm_eval/tasks/include/default/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-09-01T00:17:02,513 adding 'lm_eval/tasks/include/default/Vietnamese/utils.py' 2026-09-01T00:17:02,515 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_albanian_few_shot_en_template_yaml' 2026-09-01T00:17:02,516 adding 'lm_eval/tasks/include/few_shot_en/Albanian/_include_base_44_albanian.yaml' 2026-09-01T00:17:02,518 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-09-01T00:17:02,519 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-09-01T00:17:02,520 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-09-01T00:17:02,521 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_social_science.yaml' 2026-09-01T00:17:02,522 adding 'lm_eval/tasks/include/few_shot_en/Albanian/include_base_44_albanian_stem.yaml' 2026-09-01T00:17:02,523 adding 'lm_eval/tasks/include/few_shot_en/Albanian/utils.py' 2026-09-01T00:17:02,525 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_arabic_few_shot_en_template_yaml' 2026-09-01T00:17:02,526 adding 'lm_eval/tasks/include/few_shot_en/Arabic/_include_base_44_arabic.yaml' 2026-09-01T00:17:02,527 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-09-01T00:17:02,529 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-09-01T00:17:02,530 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_driving_license.yaml' 2026-09-01T00:17:02,531 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-09-01T00:17:02,533 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_social_science.yaml' 2026-09-01T00:17:02,534 adding 'lm_eval/tasks/include/few_shot_en/Arabic/include_base_44_arabic_stem.yaml' 2026-09-01T00:17:02,535 adding 'lm_eval/tasks/include/few_shot_en/Arabic/utils.py' 2026-09-01T00:17:02,538 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_armenian_few_shot_en_template_yaml' 2026-09-01T00:17:02,540 adding 'lm_eval/tasks/include/few_shot_en/Armenian/_include_base_44_armenian.yaml' 2026-09-01T00:17:02,541 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-09-01T00:17:02,543 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_driving_license.yaml' 2026-09-01T00:17:02,545 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_social_science.yaml' 2026-09-01T00:17:02,547 adding 'lm_eval/tasks/include/few_shot_en/Armenian/include_base_44_armenian_stem.yaml' 2026-09-01T00:17:02,549 adding 'lm_eval/tasks/include/few_shot_en/Armenian/utils.py' 2026-09-01T00:17:02,551 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_azerbaijani_few_shot_en_template_yaml' 2026-09-01T00:17:02,552 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-09-01T00:17:02,553 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-09-01T00:17:02,554 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-09-01T00:17:02,556 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-09-01T00:17:02,557 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-09-01T00:17:02,558 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-09-01T00:17:02,559 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-09-01T00:17:02,560 adding 'lm_eval/tasks/include/few_shot_en/Azerbaijani/utils.py' 2026-09-01T00:17:02,561 adding 'lm_eval/tasks/include/few_shot_en/Basque/_basque_few_shot_en_template_yaml' 2026-09-01T00:17:02,562 adding 'lm_eval/tasks/include/few_shot_en/Basque/_include_base_44_basque.yaml' 2026-09-01T00:17:02,564 adding 'lm_eval/tasks/include/few_shot_en/Basque/include_base_44_basque_professional_certification.yaml' 2026-09-01T00:17:02,565 adding 'lm_eval/tasks/include/few_shot_en/Basque/utils.py' 2026-09-01T00:17:02,567 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_belarusian_few_shot_en_template_yaml' 2026-09-01T00:17:02,568 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/_include_base_44_belarusian.yaml' 2026-09-01T00:17:02,569 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-09-01T00:17:02,570 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-09-01T00:17:02,571 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/include_base_44_belarusian_stem.yaml' 2026-09-01T00:17:02,572 adding 'lm_eval/tasks/include/few_shot_en/Belarusian/utils.py' 2026-09-01T00:17:02,574 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_bengali_few_shot_en_template_yaml' 2026-09-01T00:17:02,575 adding 'lm_eval/tasks/include/few_shot_en/Bengali/_include_base_44_bengali.yaml' 2026-09-01T00:17:02,576 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-09-01T00:17:02,577 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-09-01T00:17:02,579 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-09-01T00:17:02,580 adding 'lm_eval/tasks/include/few_shot_en/Bengali/include_base_44_bengali_stem.yaml' 2026-09-01T00:17:02,581 adding 'lm_eval/tasks/include/few_shot_en/Bengali/utils.py' 2026-09-01T00:17:02,583 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_bulgarian_few_shot_en_template_yaml' 2026-09-01T00:17:02,584 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/_include_base_44_bulgarian.yaml' 2026-09-01T00:17:02,585 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-09-01T00:17:02,586 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-09-01T00:17:02,587 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-09-01T00:17:02,589 adding 'lm_eval/tasks/include/few_shot_en/Bulgarian/utils.py' 2026-09-01T00:17:02,590 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_chinese_few_shot_en_template_yaml' 2026-09-01T00:17:02,591 adding 'lm_eval/tasks/include/few_shot_en/Chinese/_include_base_44_chinese.yaml' 2026-09-01T00:17:02,593 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_applied_science.yaml' 2026-09-01T00:17:02,594 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-09-01T00:17:02,595 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-09-01T00:17:02,596 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_driving_license.yaml' 2026-09-01T00:17:02,597 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-09-01T00:17:02,598 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-09-01T00:17:02,599 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_social_science.yaml' 2026-09-01T00:17:02,601 adding 'lm_eval/tasks/include/few_shot_en/Chinese/include_base_44_chinese_stem.yaml' 2026-09-01T00:17:02,602 adding 'lm_eval/tasks/include/few_shot_en/Chinese/utils.py' 2026-09-01T00:17:02,603 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_croatian_few_shot_en_template_yaml' 2026-09-01T00:17:02,604 adding 'lm_eval/tasks/include/few_shot_en/Croatian/_include_base_44_croatian.yaml' 2026-09-01T00:17:02,605 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-09-01T00:17:02,607 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_social_science.yaml' 2026-09-01T00:17:02,608 adding 'lm_eval/tasks/include/few_shot_en/Croatian/include_base_44_croatian_stem.yaml' 2026-09-01T00:17:02,609 adding 'lm_eval/tasks/include/few_shot_en/Croatian/utils.py' 2026-09-01T00:17:02,611 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_dutch_few_shot_en_template_yaml' 2026-09-01T00:17:02,612 adding 'lm_eval/tasks/include/few_shot_en/Dutch/_include_base_44_dutch.yaml' 2026-09-01T00:17:02,613 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_applied_science.yaml' 2026-09-01T00:17:02,614 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-09-01T00:17:02,615 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-09-01T00:17:02,616 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_social_science.yaml' 2026-09-01T00:17:02,618 adding 'lm_eval/tasks/include/few_shot_en/Dutch/include_base_44_dutch_stem.yaml' 2026-09-01T00:17:02,619 adding 'lm_eval/tasks/include/few_shot_en/Dutch/utils.py' 2026-09-01T00:17:02,621 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_estonian_few_shot_en_template_yaml' 2026-09-01T00:17:02,622 adding 'lm_eval/tasks/include/few_shot_en/Estonian/_include_base_44_estonian.yaml' 2026-09-01T00:17:02,623 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_applied_science.yaml' 2026-09-01T00:17:02,624 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-09-01T00:17:02,625 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-09-01T00:17:02,626 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_social_science.yaml' 2026-09-01T00:17:02,628 adding 'lm_eval/tasks/include/few_shot_en/Estonian/include_base_44_estonian_stem.yaml' 2026-09-01T00:17:02,629 adding 'lm_eval/tasks/include/few_shot_en/Estonian/utils.py' 2026-09-01T00:17:02,630 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_finnish_few_shot_en_template_yaml' 2026-09-01T00:17:02,631 adding 'lm_eval/tasks/include/few_shot_en/Finnish/_include_base_44_finnish.yaml' 2026-09-01T00:17:02,633 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_applied_science.yaml' 2026-09-01T00:17:02,634 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-09-01T00:17:02,635 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-09-01T00:17:02,636 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_social_science.yaml' 2026-09-01T00:17:02,637 adding 'lm_eval/tasks/include/few_shot_en/Finnish/include_base_44_finnish_stem.yaml' 2026-09-01T00:17:02,639 adding 'lm_eval/tasks/include/few_shot_en/Finnish/utils.py' 2026-09-01T00:17:02,640 adding 'lm_eval/tasks/include/few_shot_en/French/_french_few_shot_en_template_yaml' 2026-09-01T00:17:02,642 adding 'lm_eval/tasks/include/few_shot_en/French/_include_base_44_french.yaml' 2026-09-01T00:17:02,643 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_arts_humanities.yaml' 2026-09-01T00:17:02,644 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_driving_license.yaml' 2026-09-01T00:17:02,645 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_health_oriented_education.yaml' 2026-09-01T00:17:02,646 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_social_science.yaml' 2026-09-01T00:17:02,647 adding 'lm_eval/tasks/include/few_shot_en/French/include_base_44_french_stem.yaml' 2026-09-01T00:17:02,648 adding 'lm_eval/tasks/include/few_shot_en/French/utils.py' 2026-09-01T00:17:02,650 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_georgian_few_shot_en_template_yaml' 2026-09-01T00:17:02,651 adding 'lm_eval/tasks/include/few_shot_en/Georgian/_include_base_44_georgian.yaml' 2026-09-01T00:17:02,652 adding 'lm_eval/tasks/include/few_shot_en/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-09-01T00:17:02,653 adding 'lm_eval/tasks/include/few_shot_en/Georgian/utils.py' 2026-09-01T00:17:02,655 adding 'lm_eval/tasks/include/few_shot_en/German/_german_few_shot_en_template_yaml' 2026-09-01T00:17:02,656 adding 'lm_eval/tasks/include/few_shot_en/German/_include_base_44_german.yaml' 2026-09-01T00:17:02,657 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_driving_license.yaml' 2026-09-01T00:17:02,658 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_social_science.yaml' 2026-09-01T00:17:02,659 adding 'lm_eval/tasks/include/few_shot_en/German/include_base_44_german_stem.yaml' 2026-09-01T00:17:02,660 adding 'lm_eval/tasks/include/few_shot_en/German/utils.py' 2026-09-01T00:17:02,662 adding 'lm_eval/tasks/include/few_shot_en/Greek/_greek_few_shot_en_template_yaml' 2026-09-01T00:17:02,663 adding 'lm_eval/tasks/include/few_shot_en/Greek/_include_base_44_greek.yaml' 2026-09-01T00:17:02,665 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_arts_humanities.yaml' 2026-09-01T00:17:02,666 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_business_commerce.yaml' 2026-09-01T00:17:02,667 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-09-01T00:17:02,668 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_medical_license.yaml' 2026-09-01T00:17:02,669 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_professional_certification.yaml' 2026-09-01T00:17:02,670 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_social_science.yaml' 2026-09-01T00:17:02,671 adding 'lm_eval/tasks/include/few_shot_en/Greek/include_base_44_greek_stem.yaml' 2026-09-01T00:17:02,672 adding 'lm_eval/tasks/include/few_shot_en/Greek/utils.py' 2026-09-01T00:17:02,674 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_hebrew_few_shot_en_template_yaml' 2026-09-01T00:17:02,675 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/_include_base_44_hebrew.yaml' 2026-09-01T00:17:02,677 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-09-01T00:17:02,678 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-09-01T00:17:02,679 adding 'lm_eval/tasks/include/few_shot_en/Hebrew/utils.py' 2026-09-01T00:17:02,681 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_hindi_few_shot_en_template_yaml' 2026-09-01T00:17:02,682 adding 'lm_eval/tasks/include/few_shot_en/Hindi/_include_base_44_hindi.yaml' 2026-09-01T00:17:02,683 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_applied_science.yaml' 2026-09-01T00:17:02,684 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-09-01T00:17:02,685 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_driving_license.yaml' 2026-09-01T00:17:02,687 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-09-01T00:17:02,688 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-09-01T00:17:02,689 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-09-01T00:17:02,690 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_social_science.yaml' 2026-09-01T00:17:02,691 adding 'lm_eval/tasks/include/few_shot_en/Hindi/include_base_44_hindi_stem.yaml' 2026-09-01T00:17:02,692 adding 'lm_eval/tasks/include/few_shot_en/Hindi/utils.py' 2026-09-01T00:17:02,694 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_hungarian_few_shot_en_template_yaml' 2026-09-01T00:17:02,695 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/_include_base_44_hungarian.yaml' 2026-09-01T00:17:02,696 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-09-01T00:17:02,697 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-09-01T00:17:02,698 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/include_base_44_hungarian_stem.yaml' 2026-09-01T00:17:02,699 adding 'lm_eval/tasks/include/few_shot_en/Hungarian/utils.py' 2026-09-01T00:17:02,701 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_include_base_44_indonesian.yaml' 2026-09-01T00:17:02,702 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/_indonesian_few_shot_en_template_yaml' 2026-09-01T00:17:02,703 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-09-01T00:17:02,705 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-09-01T00:17:02,706 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-09-01T00:17:02,707 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-09-01T00:17:02,708 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/include_base_44_indonesian_stem.yaml' 2026-09-01T00:17:02,709 adding 'lm_eval/tasks/include/few_shot_en/Indonesian/utils.py' 2026-09-01T00:17:02,711 adding 'lm_eval/tasks/include/few_shot_en/Italian/_include_base_44_italian.yaml' 2026-09-01T00:17:02,712 adding 'lm_eval/tasks/include/few_shot_en/Italian/_italian_few_shot_en_template_yaml' 2026-09-01T00:17:02,713 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_applied_science.yaml' 2026-09-01T00:17:02,715 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_arts_humanities.yaml' 2026-09-01T00:17:02,716 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-09-01T00:17:02,717 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_professional_certification.yaml' 2026-09-01T00:17:02,718 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_social_science.yaml' 2026-09-01T00:17:02,719 adding 'lm_eval/tasks/include/few_shot_en/Italian/include_base_44_italian_stem.yaml' 2026-09-01T00:17:02,720 adding 'lm_eval/tasks/include/few_shot_en/Italian/utils.py' 2026-09-01T00:17:02,722 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_include_base_44_japanese.yaml' 2026-09-01T00:17:02,723 adding 'lm_eval/tasks/include/few_shot_en/Japanese/_japanese_few_shot_en_template_yaml' 2026-09-01T00:17:02,724 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_driving_license.yaml' 2026-09-01T00:17:02,726 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_medical_license.yaml' 2026-09-01T00:17:02,727 adding 'lm_eval/tasks/include/few_shot_en/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-09-01T00:17:02,728 adding 'lm_eval/tasks/include/few_shot_en/Japanese/utils.py' 2026-09-01T00:17:02,730 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_include_base_44_kazakh.yaml' 2026-09-01T00:17:02,731 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/_kazakh_few_shot_en_template_yaml' 2026-09-01T00:17:02,732 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-09-01T00:17:02,733 adding 'lm_eval/tasks/include/few_shot_en/Kazakh/utils.py' 2026-09-01T00:17:02,734 adding 'lm_eval/tasks/include/few_shot_en/Korean/_include_base_44_korean.yaml' 2026-09-01T00:17:02,736 adding 'lm_eval/tasks/include/few_shot_en/Korean/_korean_few_shot_en_template_yaml' 2026-09-01T00:17:02,737 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_professional_certification.yaml' 2026-09-01T00:17:02,738 adding 'lm_eval/tasks/include/few_shot_en/Korean/include_base_44_korean_social_science.yaml' 2026-09-01T00:17:02,739 adding 'lm_eval/tasks/include/few_shot_en/Korean/utils.py' 2026-09-01T00:17:02,740 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_include_base_44_lithuanian.yaml' 2026-09-01T00:17:02,742 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/_lithuanian_few_shot_en_template_yaml' 2026-09-01T00:17:02,743 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-09-01T00:17:02,744 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-09-01T00:17:02,745 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-09-01T00:17:02,746 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-09-01T00:17:02,747 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-09-01T00:17:02,748 adding 'lm_eval/tasks/include/few_shot_en/Lithuanian/utils.py' 2026-09-01T00:17:02,750 adding 'lm_eval/tasks/include/few_shot_en/Malay/_include_base_44_malay.yaml' 2026-09-01T00:17:02,751 adding 'lm_eval/tasks/include/few_shot_en/Malay/_malay_few_shot_en_template_yaml' 2026-09-01T00:17:02,752 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_arts_humanities.yaml' 2026-09-01T00:17:02,754 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_business_commerce.yaml' 2026-09-01T00:17:02,755 adding 'lm_eval/tasks/include/few_shot_en/Malay/include_base_44_malay_social_science.yaml' 2026-09-01T00:17:02,756 adding 'lm_eval/tasks/include/few_shot_en/Malay/utils.py' 2026-09-01T00:17:02,758 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_include_base_44_malayalam.yaml' 2026-09-01T00:17:02,759 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/_malayalam_few_shot_en_template_yaml' 2026-09-01T00:17:02,760 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-09-01T00:17:02,761 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-09-01T00:17:02,762 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-09-01T00:17:02,764 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-09-01T00:17:02,765 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-09-01T00:17:02,766 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/include_base_44_malayalam_stem.yaml' 2026-09-01T00:17:02,767 adding 'lm_eval/tasks/include/few_shot_en/Malayalam/utils.py' 2026-09-01T00:17:02,769 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_include_base_44_nepali.yaml' 2026-09-01T00:17:02,770 adding 'lm_eval/tasks/include/few_shot_en/Nepali/_nepali_few_shot_en_template_yaml' 2026-09-01T00:17:02,771 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_driving_license.yaml' 2026-09-01T00:17:02,772 adding 'lm_eval/tasks/include/few_shot_en/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-09-01T00:17:02,774 adding 'lm_eval/tasks/include/few_shot_en/Nepali/utils.py' 2026-09-01T00:17:02,776 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_include_base_44_north_macedonian.yaml' 2026-09-01T00:17:02,777 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/_north_macedonian_few_shot_en_template_yaml' 2026-09-01T00:17:02,778 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml' 2026-09-01T00:17:02,779 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml' 2026-09-01T00:17:02,780 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_social_science.yaml' 2026-09-01T00:17:02,781 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/include_base_44_north_macedonian_stem.yaml' 2026-09-01T00:17:02,782 adding 'lm_eval/tasks/include/few_shot_en/North Macedonian/utils.py' 2026-09-01T00:17:02,784 adding 'lm_eval/tasks/include/few_shot_en/Persian/_include_base_44_persian.yaml' 2026-09-01T00:17:02,785 adding 'lm_eval/tasks/include/few_shot_en/Persian/_persian_few_shot_en_template_yaml' 2026-09-01T00:17:02,786 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_arts_humanities.yaml' 2026-09-01T00:17:02,788 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_driving_license.yaml' 2026-09-01T00:17:02,789 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_professional_certification.yaml' 2026-09-01T00:17:02,790 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_social_science.yaml' 2026-09-01T00:17:02,791 adding 'lm_eval/tasks/include/few_shot_en/Persian/include_base_44_persian_stem.yaml' 2026-09-01T00:17:02,792 adding 'lm_eval/tasks/include/few_shot_en/Persian/utils.py' 2026-09-01T00:17:02,794 adding 'lm_eval/tasks/include/few_shot_en/Polish/_include_base_44_polish.yaml' 2026-09-01T00:17:02,795 adding 'lm_eval/tasks/include/few_shot_en/Polish/_polish_few_shot_en_template_yaml' 2026-09-01T00:17:02,796 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_professional_certification.yaml' 2026-09-01T00:17:02,798 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_social_science.yaml' 2026-09-01T00:17:02,799 adding 'lm_eval/tasks/include/few_shot_en/Polish/include_base_44_polish_stem.yaml' 2026-09-01T00:17:02,800 adding 'lm_eval/tasks/include/few_shot_en/Polish/utils.py' 2026-09-01T00:17:02,802 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_include_base_44_portuguese.yaml' 2026-09-01T00:17:02,803 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/_portuguese_few_shot_en_template_yaml' 2026-09-01T00:17:02,804 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-09-01T00:17:02,805 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-09-01T00:17:02,806 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-09-01T00:17:02,808 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-09-01T00:17:02,809 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-09-01T00:17:02,810 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/include_base_44_portuguese_stem.yaml' 2026-09-01T00:17:02,811 adding 'lm_eval/tasks/include/few_shot_en/Portuguese/utils.py' 2026-09-01T00:17:02,814 adding 'lm_eval/tasks/include/few_shot_en/Russian/_include_base_44_russian.yaml' 2026-09-01T00:17:02,815 adding 'lm_eval/tasks/include/few_shot_en/Russian/_russian_few_shot_en_template_yaml' 2026-09-01T00:17:02,816 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_applied_science.yaml' 2026-09-01T00:17:02,818 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_arts_humanities.yaml' 2026-09-01T00:17:02,819 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_business_commerce.yaml' 2026-09-01T00:17:02,820 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_driving_license.yaml' 2026-09-01T00:17:02,821 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-09-01T00:17:02,822 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_marine_license.yaml' 2026-09-01T00:17:02,823 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_social_science.yaml' 2026-09-01T00:17:02,824 adding 'lm_eval/tasks/include/few_shot_en/Russian/include_base_44_russian_stem.yaml' 2026-09-01T00:17:02,825 adding 'lm_eval/tasks/include/few_shot_en/Russian/utils.py' 2026-09-01T00:17:02,827 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_include_base_44_serbian.yaml' 2026-09-01T00:17:02,828 adding 'lm_eval/tasks/include/few_shot_en/Serbian/_serbian_few_shot_en_template_yaml' 2026-09-01T00:17:02,829 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-09-01T00:17:02,831 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_social_science.yaml' 2026-09-01T00:17:02,832 adding 'lm_eval/tasks/include/few_shot_en/Serbian/include_base_44_serbian_stem.yaml' 2026-09-01T00:17:02,833 adding 'lm_eval/tasks/include/few_shot_en/Serbian/utils.py' 2026-09-01T00:17:02,835 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_include_base_44_spanish.yaml' 2026-09-01T00:17:02,836 adding 'lm_eval/tasks/include/few_shot_en/Spanish/_spanish_few_shot_en_template_yaml' 2026-09-01T00:17:02,837 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-09-01T00:17:02,838 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-09-01T00:17:02,839 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_social_science.yaml' 2026-09-01T00:17:02,840 adding 'lm_eval/tasks/include/few_shot_en/Spanish/include_base_44_spanish_stem.yaml' 2026-09-01T00:17:02,842 adding 'lm_eval/tasks/include/few_shot_en/Spanish/utils.py' 2026-09-01T00:17:02,843 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_include_base_44_tagalog.yaml' 2026-09-01T00:17:02,845 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/_tagalog_few_shot_en_template_yaml' 2026-09-01T00:17:02,846 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-09-01T00:17:02,847 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-09-01T00:17:02,848 adding 'lm_eval/tasks/include/few_shot_en/Tagalog/utils.py' 2026-09-01T00:17:02,850 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_include_base_44_tamil.yaml' 2026-09-01T00:17:02,852 adding 'lm_eval/tasks/include/few_shot_en/Tamil/_tamil_few_shot_en_template_yaml' 2026-09-01T00:17:02,853 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-09-01T00:17:02,854 adding 'lm_eval/tasks/include/few_shot_en/Tamil/include_base_44_tamil_stem.yaml' 2026-09-01T00:17:02,856 adding 'lm_eval/tasks/include/few_shot_en/Tamil/utils.py' 2026-09-01T00:17:02,858 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_include_base_44_telugu.yaml' 2026-09-01T00:17:02,859 adding 'lm_eval/tasks/include/few_shot_en/Telugu/_telugu_few_shot_en_template_yaml' 2026-09-01T00:17:02,860 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_applied_science.yaml' 2026-09-01T00:17:02,861 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-09-01T00:17:02,862 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_social_science.yaml' 2026-09-01T00:17:02,864 adding 'lm_eval/tasks/include/few_shot_en/Telugu/include_base_44_telugu_stem.yaml' 2026-09-01T00:17:02,865 adding 'lm_eval/tasks/include/few_shot_en/Telugu/utils.py' 2026-09-01T00:17:02,867 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_include_base_44_turkish.yaml' 2026-09-01T00:17:02,868 adding 'lm_eval/tasks/include/few_shot_en/Turkish/_turkish_few_shot_en_template_yaml' 2026-09-01T00:17:02,869 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-09-01T00:17:02,870 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-09-01T00:17:02,871 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_social_science.yaml' 2026-09-01T00:17:02,872 adding 'lm_eval/tasks/include/few_shot_en/Turkish/include_base_44_turkish_stem.yaml' 2026-09-01T00:17:02,873 adding 'lm_eval/tasks/include/few_shot_en/Turkish/utils.py' 2026-09-01T00:17:02,875 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_include_base_44_ukrainian.yaml' 2026-09-01T00:17:02,876 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/_ukrainian_few_shot_en_template_yaml' 2026-09-01T00:17:02,877 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-09-01T00:17:02,878 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-09-01T00:17:02,880 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-09-01T00:17:02,881 adding 'lm_eval/tasks/include/few_shot_en/Ukrainian/utils.py' 2026-09-01T00:17:02,882 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_include_base_44_urdu.yaml' 2026-09-01T00:17:02,884 adding 'lm_eval/tasks/include/few_shot_en/Urdu/_urdu_few_shot_en_template_yaml' 2026-09-01T00:17:02,885 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-09-01T00:17:02,886 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-09-01T00:17:02,887 adding 'lm_eval/tasks/include/few_shot_en/Urdu/include_base_44_urdu_stem.yaml' 2026-09-01T00:17:02,888 adding 'lm_eval/tasks/include/few_shot_en/Urdu/utils.py' 2026-09-01T00:17:02,890 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_include_base_44_uzbek.yaml' 2026-09-01T00:17:02,891 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/_uzbek_few_shot_en_template_yaml' 2026-09-01T00:17:02,893 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-09-01T00:17:02,894 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-09-01T00:17:02,896 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-09-01T00:17:02,897 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/include_base_44_uzbek_stem.yaml' 2026-09-01T00:17:02,898 adding 'lm_eval/tasks/include/few_shot_en/Uzbek/utils.py' 2026-09-01T00:17:02,900 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_include_base_44_vietnamese.yaml' 2026-09-01T00:17:02,902 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/_vietnamese_few_shot_en_template_yaml' 2026-09-01T00:17:02,903 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-09-01T00:17:02,904 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-09-01T00:17:02,905 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-09-01T00:17:02,907 adding 'lm_eval/tasks/include/few_shot_en/Vietnamese/utils.py' 2026-09-01T00:17:02,911 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_albanian_few_shot_og_template_yaml' 2026-09-01T00:17:02,912 adding 'lm_eval/tasks/include/few_shot_og/Albanian/_include_base_44_albanian.yaml' 2026-09-01T00:17:02,914 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_arts_humanities.yaml' 2026-09-01T00:17:02,915 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_business_commerce.yaml' 2026-09-01T00:17:02,917 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_health_oriented_education.yaml' 2026-09-01T00:17:02,919 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_social_science.yaml' 2026-09-01T00:17:02,920 adding 'lm_eval/tasks/include/few_shot_og/Albanian/include_base_44_albanian_stem.yaml' 2026-09-01T00:17:02,922 adding 'lm_eval/tasks/include/few_shot_og/Albanian/utils.py' 2026-09-01T00:17:02,925 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_arabic_few_shot_og_template_yaml' 2026-09-01T00:17:02,926 adding 'lm_eval/tasks/include/few_shot_og/Arabic/_include_base_44_arabic.yaml' 2026-09-01T00:17:02,928 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_arts_humanities.yaml' 2026-09-01T00:17:02,929 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_business_commerce.yaml' 2026-09-01T00:17:02,930 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_driving_license.yaml' 2026-09-01T00:17:02,931 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_general_knowledge.yaml' 2026-09-01T00:17:02,932 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_social_science.yaml' 2026-09-01T00:17:02,933 adding 'lm_eval/tasks/include/few_shot_og/Arabic/include_base_44_arabic_stem.yaml' 2026-09-01T00:17:02,935 adding 'lm_eval/tasks/include/few_shot_og/Arabic/utils.py' 2026-09-01T00:17:02,936 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_armenian_few_shot_og_template_yaml' 2026-09-01T00:17:02,937 adding 'lm_eval/tasks/include/few_shot_og/Armenian/_include_base_44_armenian.yaml' 2026-09-01T00:17:02,939 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml' 2026-09-01T00:17:02,940 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml' 2026-09-01T00:17:02,941 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml' 2026-09-01T00:17:02,942 adding 'lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml' 2026-09-01T00:17:02,943 adding 'lm_eval/tasks/include/few_shot_og/Armenian/utils.py' 2026-09-01T00:17:02,945 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml' 2026-09-01T00:17:02,946 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml' 2026-09-01T00:17:02,947 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml' 2026-09-01T00:17:02,949 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml' 2026-09-01T00:17:02,950 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml' 2026-09-01T00:17:02,951 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml' 2026-09-01T00:17:02,952 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml' 2026-09-01T00:17:02,953 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml' 2026-09-01T00:17:02,954 adding 'lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py' 2026-09-01T00:17:02,956 adding 'lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml' 2026-09-01T00:17:02,957 adding 'lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml' 2026-09-01T00:17:02,958 adding 'lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml' 2026-09-01T00:17:02,959 adding 'lm_eval/tasks/include/few_shot_og/Basque/utils.py' 2026-09-01T00:17:02,961 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml' 2026-09-01T00:17:02,962 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml' 2026-09-01T00:17:02,964 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_arts_humanities.yaml' 2026-09-01T00:17:02,965 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_social_science.yaml' 2026-09-01T00:17:02,966 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/include_base_44_belarusian_stem.yaml' 2026-09-01T00:17:02,967 adding 'lm_eval/tasks/include/few_shot_og/Belarusian/utils.py' 2026-09-01T00:17:02,969 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_bengali_few_shot_og_template_yaml' 2026-09-01T00:17:02,970 adding 'lm_eval/tasks/include/few_shot_og/Bengali/_include_base_44_bengali.yaml' 2026-09-01T00:17:02,971 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_arts_humanities.yaml' 2026-09-01T00:17:02,972 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_general_knowledge.yaml' 2026-09-01T00:17:02,973 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_professional_certification.yaml' 2026-09-01T00:17:02,974 adding 'lm_eval/tasks/include/few_shot_og/Bengali/include_base_44_bengali_stem.yaml' 2026-09-01T00:17:02,975 adding 'lm_eval/tasks/include/few_shot_og/Bengali/utils.py' 2026-09-01T00:17:02,977 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_bulgarian_few_shot_og_template_yaml' 2026-09-01T00:17:02,978 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/_include_base_44_bulgarian.yaml' 2026-09-01T00:17:02,979 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_arts_humanities.yaml' 2026-09-01T00:17:02,981 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_social_science.yaml' 2026-09-01T00:17:02,982 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/include_base_44_bulgarian_stem.yaml' 2026-09-01T00:17:02,983 adding 'lm_eval/tasks/include/few_shot_og/Bulgarian/utils.py' 2026-09-01T00:17:02,985 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_chinese_few_shot_og_template_yaml' 2026-09-01T00:17:02,986 adding 'lm_eval/tasks/include/few_shot_og/Chinese/_include_base_44_chinese.yaml' 2026-09-01T00:17:02,987 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_applied_science.yaml' 2026-09-01T00:17:02,988 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_arts_humanities.yaml' 2026-09-01T00:17:02,989 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_business_commerce.yaml' 2026-09-01T00:17:02,990 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_driving_license.yaml' 2026-09-01T00:17:02,992 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_health_oriented_education.yaml' 2026-09-01T00:17:02,993 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_professional_certification.yaml' 2026-09-01T00:17:02,994 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_social_science.yaml' 2026-09-01T00:17:02,995 adding 'lm_eval/tasks/include/few_shot_og/Chinese/include_base_44_chinese_stem.yaml' 2026-09-01T00:17:02,996 adding 'lm_eval/tasks/include/few_shot_og/Chinese/utils.py' 2026-09-01T00:17:02,998 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_croatian_few_shot_og_template_yaml' 2026-09-01T00:17:02,999 adding 'lm_eval/tasks/include/few_shot_og/Croatian/_include_base_44_croatian.yaml' 2026-09-01T00:17:03,000 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_arts_humanities.yaml' 2026-09-01T00:17:03,002 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_social_science.yaml' 2026-09-01T00:17:03,003 adding 'lm_eval/tasks/include/few_shot_og/Croatian/include_base_44_croatian_stem.yaml' 2026-09-01T00:17:03,004 adding 'lm_eval/tasks/include/few_shot_og/Croatian/utils.py' 2026-09-01T00:17:03,006 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_dutch_few_shot_og_template_yaml' 2026-09-01T00:17:03,007 adding 'lm_eval/tasks/include/few_shot_og/Dutch/_include_base_44_dutch.yaml' 2026-09-01T00:17:03,008 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_applied_science.yaml' 2026-09-01T00:17:03,009 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_arts_humanities.yaml' 2026-09-01T00:17:03,011 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_health_oriented_education.yaml' 2026-09-01T00:17:03,012 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_social_science.yaml' 2026-09-01T00:17:03,013 adding 'lm_eval/tasks/include/few_shot_og/Dutch/include_base_44_dutch_stem.yaml' 2026-09-01T00:17:03,014 adding 'lm_eval/tasks/include/few_shot_og/Dutch/utils.py' 2026-09-01T00:17:03,015 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_estonian_few_shot_og_template_yaml' 2026-09-01T00:17:03,017 adding 'lm_eval/tasks/include/few_shot_og/Estonian/_include_base_44_estonian.yaml' 2026-09-01T00:17:03,018 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_applied_science.yaml' 2026-09-01T00:17:03,019 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_arts_humanities.yaml' 2026-09-01T00:17:03,020 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_health_oriented_education.yaml' 2026-09-01T00:17:03,021 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_social_science.yaml' 2026-09-01T00:17:03,022 adding 'lm_eval/tasks/include/few_shot_og/Estonian/include_base_44_estonian_stem.yaml' 2026-09-01T00:17:03,023 adding 'lm_eval/tasks/include/few_shot_og/Estonian/utils.py' 2026-09-01T00:17:03,025 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_finnish_few_shot_og_template_yaml' 2026-09-01T00:17:03,026 adding 'lm_eval/tasks/include/few_shot_og/Finnish/_include_base_44_finnish.yaml' 2026-09-01T00:17:03,027 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_applied_science.yaml' 2026-09-01T00:17:03,028 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_arts_humanities.yaml' 2026-09-01T00:17:03,029 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_health_oriented_education.yaml' 2026-09-01T00:17:03,031 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_social_science.yaml' 2026-09-01T00:17:03,032 adding 'lm_eval/tasks/include/few_shot_og/Finnish/include_base_44_finnish_stem.yaml' 2026-09-01T00:17:03,033 adding 'lm_eval/tasks/include/few_shot_og/Finnish/utils.py' 2026-09-01T00:17:03,035 adding 'lm_eval/tasks/include/few_shot_og/French/_french_few_shot_og_template_yaml' 2026-09-01T00:17:03,036 adding 'lm_eval/tasks/include/few_shot_og/French/_include_base_44_french.yaml' 2026-09-01T00:17:03,037 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_arts_humanities.yaml' 2026-09-01T00:17:03,038 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_driving_license.yaml' 2026-09-01T00:17:03,039 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_health_oriented_education.yaml' 2026-09-01T00:17:03,040 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_social_science.yaml' 2026-09-01T00:17:03,042 adding 'lm_eval/tasks/include/few_shot_og/French/include_base_44_french_stem.yaml' 2026-09-01T00:17:03,043 adding 'lm_eval/tasks/include/few_shot_og/French/utils.py' 2026-09-01T00:17:03,045 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_georgian_few_shot_og_template_yaml' 2026-09-01T00:17:03,046 adding 'lm_eval/tasks/include/few_shot_og/Georgian/_include_base_44_georgian.yaml' 2026-09-01T00:17:03,047 adding 'lm_eval/tasks/include/few_shot_og/Georgian/include_base_44_georgian_arts_humanities.yaml' 2026-09-01T00:17:03,048 adding 'lm_eval/tasks/include/few_shot_og/Georgian/utils.py' 2026-09-01T00:17:03,050 adding 'lm_eval/tasks/include/few_shot_og/German/_german_few_shot_og_template_yaml' 2026-09-01T00:17:03,051 adding 'lm_eval/tasks/include/few_shot_og/German/_include_base_44_german.yaml' 2026-09-01T00:17:03,052 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_driving_license.yaml' 2026-09-01T00:17:03,053 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_social_science.yaml' 2026-09-01T00:17:03,054 adding 'lm_eval/tasks/include/few_shot_og/German/include_base_44_german_stem.yaml' 2026-09-01T00:17:03,055 adding 'lm_eval/tasks/include/few_shot_og/German/utils.py' 2026-09-01T00:17:03,057 adding 'lm_eval/tasks/include/few_shot_og/Greek/_greek_few_shot_og_template_yaml' 2026-09-01T00:17:03,058 adding 'lm_eval/tasks/include/few_shot_og/Greek/_include_base_44_greek.yaml' 2026-09-01T00:17:03,059 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_arts_humanities.yaml' 2026-09-01T00:17:03,060 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_business_commerce.yaml' 2026-09-01T00:17:03,061 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_health_oriented_education.yaml' 2026-09-01T00:17:03,063 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_medical_license.yaml' 2026-09-01T00:17:03,064 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_professional_certification.yaml' 2026-09-01T00:17:03,065 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_social_science.yaml' 2026-09-01T00:17:03,066 adding 'lm_eval/tasks/include/few_shot_og/Greek/include_base_44_greek_stem.yaml' 2026-09-01T00:17:03,067 adding 'lm_eval/tasks/include/few_shot_og/Greek/utils.py' 2026-09-01T00:17:03,069 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_hebrew_few_shot_og_template_yaml' 2026-09-01T00:17:03,070 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/_include_base_44_hebrew.yaml' 2026-09-01T00:17:03,071 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_arts_humanities.yaml' 2026-09-01T00:17:03,072 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/include_base_44_hebrew_driving_license.yaml' 2026-09-01T00:17:03,073 adding 'lm_eval/tasks/include/few_shot_og/Hebrew/utils.py' 2026-09-01T00:17:03,075 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_hindi_few_shot_og_template_yaml' 2026-09-01T00:17:03,077 adding 'lm_eval/tasks/include/few_shot_og/Hindi/_include_base_44_hindi.yaml' 2026-09-01T00:17:03,078 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_applied_science.yaml' 2026-09-01T00:17:03,079 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_arts_humanities.yaml' 2026-09-01T00:17:03,080 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_driving_license.yaml' 2026-09-01T00:17:03,081 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_general_knowledge.yaml' 2026-09-01T00:17:03,082 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_health_oriented_education.yaml' 2026-09-01T00:17:03,084 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_professional_certification.yaml' 2026-09-01T00:17:03,085 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_social_science.yaml' 2026-09-01T00:17:03,086 adding 'lm_eval/tasks/include/few_shot_og/Hindi/include_base_44_hindi_stem.yaml' 2026-09-01T00:17:03,087 adding 'lm_eval/tasks/include/few_shot_og/Hindi/utils.py' 2026-09-01T00:17:03,089 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_hungarian_few_shot_og_template_yaml' 2026-09-01T00:17:03,090 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/_include_base_44_hungarian.yaml' 2026-09-01T00:17:03,091 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_applied_science.yaml' 2026-09-01T00:17:03,092 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_social_science.yaml' 2026-09-01T00:17:03,093 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/include_base_44_hungarian_stem.yaml' 2026-09-01T00:17:03,095 adding 'lm_eval/tasks/include/few_shot_og/Hungarian/utils.py' 2026-09-01T00:17:03,097 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_include_base_44_indonesian.yaml' 2026-09-01T00:17:03,098 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/_indonesian_few_shot_og_template_yaml' 2026-09-01T00:17:03,099 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_applied_science.yaml' 2026-09-01T00:17:03,100 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_arts_humanities.yaml' 2026-09-01T00:17:03,101 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_professional_certification.yaml' 2026-09-01T00:17:03,102 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_social_science.yaml' 2026-09-01T00:17:03,103 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/include_base_44_indonesian_stem.yaml' 2026-09-01T00:17:03,104 adding 'lm_eval/tasks/include/few_shot_og/Indonesian/utils.py' 2026-09-01T00:17:03,106 adding 'lm_eval/tasks/include/few_shot_og/Italian/_include_base_44_italian.yaml' 2026-09-01T00:17:03,107 adding 'lm_eval/tasks/include/few_shot_og/Italian/_italian_few_shot_og_template_yaml' 2026-09-01T00:17:03,108 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_applied_science.yaml' 2026-09-01T00:17:03,109 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_arts_humanities.yaml' 2026-09-01T00:17:03,110 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_health_oriented_education.yaml' 2026-09-01T00:17:03,111 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_professional_certification.yaml' 2026-09-01T00:17:03,113 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_social_science.yaml' 2026-09-01T00:17:03,114 adding 'lm_eval/tasks/include/few_shot_og/Italian/include_base_44_italian_stem.yaml' 2026-09-01T00:17:03,115 adding 'lm_eval/tasks/include/few_shot_og/Italian/utils.py' 2026-09-01T00:17:03,116 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_include_base_44_japanese.yaml' 2026-09-01T00:17:03,118 adding 'lm_eval/tasks/include/few_shot_og/Japanese/_japanese_few_shot_og_template_yaml' 2026-09-01T00:17:03,119 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_driving_license.yaml' 2026-09-01T00:17:03,120 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_medical_license.yaml' 2026-09-01T00:17:03,121 adding 'lm_eval/tasks/include/few_shot_og/Japanese/include_base_44_japanese_professional_certification.yaml' 2026-09-01T00:17:03,122 adding 'lm_eval/tasks/include/few_shot_og/Japanese/utils.py' 2026-09-01T00:17:03,124 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_include_base_44_kazakh.yaml' 2026-09-01T00:17:03,125 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/_kazakh_few_shot_og_template_yaml' 2026-09-01T00:17:03,126 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/include_base_44_kazakh_arts_humanities.yaml' 2026-09-01T00:17:03,127 adding 'lm_eval/tasks/include/few_shot_og/Kazakh/utils.py' 2026-09-01T00:17:03,129 adding 'lm_eval/tasks/include/few_shot_og/Korean/_include_base_44_korean.yaml' 2026-09-01T00:17:03,130 adding 'lm_eval/tasks/include/few_shot_og/Korean/_korean_few_shot_og_template_yaml' 2026-09-01T00:17:03,131 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_professional_certification.yaml' 2026-09-01T00:17:03,133 adding 'lm_eval/tasks/include/few_shot_og/Korean/include_base_44_korean_social_science.yaml' 2026-09-01T00:17:03,134 adding 'lm_eval/tasks/include/few_shot_og/Korean/utils.py' 2026-09-01T00:17:03,136 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_include_base_44_lithuanian.yaml' 2026-09-01T00:17:03,137 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/_lithuanian_few_shot_og_template_yaml' 2026-09-01T00:17:03,138 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_arts_humanities.yaml' 2026-09-01T00:17:03,139 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_business_commerce.yaml' 2026-09-01T00:17:03,140 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_professional_certification.yaml' 2026-09-01T00:17:03,142 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_social_science.yaml' 2026-09-01T00:17:03,143 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/include_base_44_lithuanian_stem.yaml' 2026-09-01T00:17:03,144 adding 'lm_eval/tasks/include/few_shot_og/Lithuanian/utils.py' 2026-09-01T00:17:03,146 adding 'lm_eval/tasks/include/few_shot_og/Malay/_include_base_44_malay.yaml' 2026-09-01T00:17:03,147 adding 'lm_eval/tasks/include/few_shot_og/Malay/_malay_few_shot_og_template_yaml' 2026-09-01T00:17:03,148 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_arts_humanities.yaml' 2026-09-01T00:17:03,149 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_business_commerce.yaml' 2026-09-01T00:17:03,150 adding 'lm_eval/tasks/include/few_shot_og/Malay/include_base_44_malay_social_science.yaml' 2026-09-01T00:17:03,151 adding 'lm_eval/tasks/include/few_shot_og/Malay/utils.py' 2026-09-01T00:17:03,153 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_include_base_44_malayalam.yaml' 2026-09-01T00:17:03,154 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/_malayalam_few_shot_og_template_yaml' 2026-09-01T00:17:03,155 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_arts_humanities.yaml' 2026-09-01T00:17:03,156 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_general_knowledge.yaml' 2026-09-01T00:17:03,157 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_health_oriented_education.yaml' 2026-09-01T00:17:03,158 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_marine_license.yaml' 2026-09-01T00:17:03,159 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_social_science.yaml' 2026-09-01T00:17:03,161 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/include_base_44_malayalam_stem.yaml' 2026-09-01T00:17:03,162 adding 'lm_eval/tasks/include/few_shot_og/Malayalam/utils.py' 2026-09-01T00:17:03,164 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_include_base_44_nepali.yaml' 2026-09-01T00:17:03,165 adding 'lm_eval/tasks/include/few_shot_og/Nepali/_nepali_few_shot_og_template_yaml' 2026-09-01T00:17:03,166 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_driving_license.yaml' 2026-09-01T00:17:03,167 adding 'lm_eval/tasks/include/few_shot_og/Nepali/include_base_44_nepali_professional_certification.yaml' 2026-09-01T00:17:03,168 adding 'lm_eval/tasks/include/few_shot_og/Nepali/utils.py' 2026-09-01T00:17:03,170 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_include_base_44_north_macedonian.yaml' 2026-09-01T00:17:03,171 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/_north_macedonian_few_shot_og_template_yaml' 2026-09-01T00:17:03,172 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_arts_humanities.yaml' 2026-09-01T00:17:03,173 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_business_commerce.yaml' 2026-09-01T00:17:03,175 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_social_science.yaml' 2026-09-01T00:17:03,176 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/include_base_44_north_macedonian_stem.yaml' 2026-09-01T00:17:03,177 adding 'lm_eval/tasks/include/few_shot_og/North Macedonian/utils.py' 2026-09-01T00:17:03,179 adding 'lm_eval/tasks/include/few_shot_og/Persian/_include_base_44_persian.yaml' 2026-09-01T00:17:03,180 adding 'lm_eval/tasks/include/few_shot_og/Persian/_persian_few_shot_og_template_yaml' 2026-09-01T00:17:03,181 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_arts_humanities.yaml' 2026-09-01T00:17:03,182 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_driving_license.yaml' 2026-09-01T00:17:03,183 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_professional_certification.yaml' 2026-09-01T00:17:03,185 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_social_science.yaml' 2026-09-01T00:17:03,186 adding 'lm_eval/tasks/include/few_shot_og/Persian/include_base_44_persian_stem.yaml' 2026-09-01T00:17:03,187 adding 'lm_eval/tasks/include/few_shot_og/Persian/utils.py' 2026-09-01T00:17:03,188 adding 'lm_eval/tasks/include/few_shot_og/Polish/_include_base_44_polish.yaml' 2026-09-01T00:17:03,190 adding 'lm_eval/tasks/include/few_shot_og/Polish/_polish_few_shot_og_template_yaml' 2026-09-01T00:17:03,191 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_professional_certification.yaml' 2026-09-01T00:17:03,192 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_social_science.yaml' 2026-09-01T00:17:03,193 adding 'lm_eval/tasks/include/few_shot_og/Polish/include_base_44_polish_stem.yaml' 2026-09-01T00:17:03,194 adding 'lm_eval/tasks/include/few_shot_og/Polish/utils.py' 2026-09-01T00:17:03,196 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_include_base_44_portuguese.yaml' 2026-09-01T00:17:03,197 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/_portuguese_few_shot_og_template_yaml' 2026-09-01T00:17:03,198 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_applied_science.yaml' 2026-09-01T00:17:03,199 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_arts_humanities.yaml' 2026-09-01T00:17:03,200 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_business_commerce.yaml' 2026-09-01T00:17:03,201 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_health_oriented_education.yaml' 2026-09-01T00:17:03,202 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_social_science.yaml' 2026-09-01T00:17:03,203 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/include_base_44_portuguese_stem.yaml' 2026-09-01T00:17:03,205 adding 'lm_eval/tasks/include/few_shot_og/Portuguese/utils.py' 2026-09-01T00:17:03,207 adding 'lm_eval/tasks/include/few_shot_og/Russian/_include_base_44_russian.yaml' 2026-09-01T00:17:03,208 adding 'lm_eval/tasks/include/few_shot_og/Russian/_russian_few_shot_og_template_yaml' 2026-09-01T00:17:03,209 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_applied_science.yaml' 2026-09-01T00:17:03,210 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_arts_humanities.yaml' 2026-09-01T00:17:03,211 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_business_commerce.yaml' 2026-09-01T00:17:03,212 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_driving_license.yaml' 2026-09-01T00:17:03,214 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_health_oriented_education.yaml' 2026-09-01T00:17:03,215 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_marine_license.yaml' 2026-09-01T00:17:03,216 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_social_science.yaml' 2026-09-01T00:17:03,217 adding 'lm_eval/tasks/include/few_shot_og/Russian/include_base_44_russian_stem.yaml' 2026-09-01T00:17:03,218 adding 'lm_eval/tasks/include/few_shot_og/Russian/utils.py' 2026-09-01T00:17:03,220 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_include_base_44_serbian.yaml' 2026-09-01T00:17:03,221 adding 'lm_eval/tasks/include/few_shot_og/Serbian/_serbian_few_shot_og_template_yaml' 2026-09-01T00:17:03,223 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_arts_humanities.yaml' 2026-09-01T00:17:03,224 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_social_science.yaml' 2026-09-01T00:17:03,225 adding 'lm_eval/tasks/include/few_shot_og/Serbian/include_base_44_serbian_stem.yaml' 2026-09-01T00:17:03,226 adding 'lm_eval/tasks/include/few_shot_og/Serbian/utils.py' 2026-09-01T00:17:03,228 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_include_base_44_spanish.yaml' 2026-09-01T00:17:03,229 adding 'lm_eval/tasks/include/few_shot_og/Spanish/_spanish_few_shot_og_template_yaml' 2026-09-01T00:17:03,230 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_arts_humanities.yaml' 2026-09-01T00:17:03,231 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_health_oriented_education.yaml' 2026-09-01T00:17:03,233 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_social_science.yaml' 2026-09-01T00:17:03,234 adding 'lm_eval/tasks/include/few_shot_og/Spanish/include_base_44_spanish_stem.yaml' 2026-09-01T00:17:03,235 adding 'lm_eval/tasks/include/few_shot_og/Spanish/utils.py' 2026-09-01T00:17:03,236 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_include_base_44_tagalog.yaml' 2026-09-01T00:17:03,238 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/_tagalog_few_shot_og_template_yaml' 2026-09-01T00:17:03,239 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_arts_humanities.yaml' 2026-09-01T00:17:03,240 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/include_base_44_tagalog_driving_license.yaml' 2026-09-01T00:17:03,241 adding 'lm_eval/tasks/include/few_shot_og/Tagalog/utils.py' 2026-09-01T00:17:03,243 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_include_base_44_tamil.yaml' 2026-09-01T00:17:03,244 adding 'lm_eval/tasks/include/few_shot_og/Tamil/_tamil_few_shot_og_template_yaml' 2026-09-01T00:17:03,245 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_general_knowledge.yaml' 2026-09-01T00:17:03,246 adding 'lm_eval/tasks/include/few_shot_og/Tamil/include_base_44_tamil_stem.yaml' 2026-09-01T00:17:03,247 adding 'lm_eval/tasks/include/few_shot_og/Tamil/utils.py' 2026-09-01T00:17:03,249 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_include_base_44_telugu.yaml' 2026-09-01T00:17:03,250 adding 'lm_eval/tasks/include/few_shot_og/Telugu/_telugu_few_shot_og_template_yaml' 2026-09-01T00:17:03,251 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_applied_science.yaml' 2026-09-01T00:17:03,252 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_arts_humanities.yaml' 2026-09-01T00:17:03,253 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_social_science.yaml' 2026-09-01T00:17:03,255 adding 'lm_eval/tasks/include/few_shot_og/Telugu/include_base_44_telugu_stem.yaml' 2026-09-01T00:17:03,256 adding 'lm_eval/tasks/include/few_shot_og/Telugu/utils.py' 2026-09-01T00:17:03,258 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_include_base_44_turkish.yaml' 2026-09-01T00:17:03,259 adding 'lm_eval/tasks/include/few_shot_og/Turkish/_turkish_few_shot_og_template_yaml' 2026-09-01T00:17:03,260 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_arts_humanities.yaml' 2026-09-01T00:17:03,261 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_business_commerce.yaml' 2026-09-01T00:17:03,262 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_social_science.yaml' 2026-09-01T00:17:03,264 adding 'lm_eval/tasks/include/few_shot_og/Turkish/include_base_44_turkish_stem.yaml' 2026-09-01T00:17:03,265 adding 'lm_eval/tasks/include/few_shot_og/Turkish/utils.py' 2026-09-01T00:17:03,267 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_include_base_44_ukrainian.yaml' 2026-09-01T00:17:03,268 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/_ukrainian_few_shot_og_template_yaml' 2026-09-01T00:17:03,269 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_arts_humanities.yaml' 2026-09-01T00:17:03,270 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_social_science.yaml' 2026-09-01T00:17:03,271 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/include_base_44_ukrainian_stem.yaml' 2026-09-01T00:17:03,272 adding 'lm_eval/tasks/include/few_shot_og/Ukrainian/utils.py' 2026-09-01T00:17:03,274 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_include_base_44_urdu.yaml' 2026-09-01T00:17:03,276 adding 'lm_eval/tasks/include/few_shot_og/Urdu/_urdu_few_shot_og_template_yaml' 2026-09-01T00:17:03,277 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_arts_humanities.yaml' 2026-09-01T00:17:03,278 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_health_oriented_education.yaml' 2026-09-01T00:17:03,279 adding 'lm_eval/tasks/include/few_shot_og/Urdu/include_base_44_urdu_stem.yaml' 2026-09-01T00:17:03,280 adding 'lm_eval/tasks/include/few_shot_og/Urdu/utils.py' 2026-09-01T00:17:03,281 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_include_base_44_uzbek.yaml' 2026-09-01T00:17:03,283 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/_uzbek_few_shot_og_template_yaml' 2026-09-01T00:17:03,284 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_arts_humanities.yaml' 2026-09-01T00:17:03,285 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_medical_license.yaml' 2026-09-01T00:17:03,286 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_social_science.yaml' 2026-09-01T00:17:03,287 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/include_base_44_uzbek_stem.yaml' 2026-09-01T00:17:03,288 adding 'lm_eval/tasks/include/few_shot_og/Uzbek/utils.py' 2026-09-01T00:17:03,290 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_include_base_44_vietnamese.yaml' 2026-09-01T00:17:03,291 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/_vietnamese_few_shot_og_template_yaml' 2026-09-01T00:17:03,292 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_arts_humanities.yaml' 2026-09-01T00:17:03,294 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_social_science.yaml' 2026-09-01T00:17:03,295 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/include_base_44_vietnamese_stem.yaml' 2026-09-01T00:17:03,296 adding 'lm_eval/tasks/include/few_shot_og/Vietnamese/utils.py' 2026-09-01T00:17:03,298 adding 'lm_eval/tasks/indicparam/README.md' 2026-09-01T00:17:03,299 adding 'lm_eval/tasks/indicparam/_default_indicparam_template_yaml' 2026-09-01T00:17:03,300 adding 'lm_eval/tasks/indicparam/_indicparam.yaml' 2026-09-01T00:17:03,301 adding 'lm_eval/tasks/indicparam/indicparam_bodo.yaml' 2026-09-01T00:17:03,302 adding 'lm_eval/tasks/indicparam/indicparam_dogri.yaml' 2026-09-01T00:17:03,303 adding 'lm_eval/tasks/indicparam/indicparam_gujarati.yaml' 2026-09-01T00:17:03,305 adding 'lm_eval/tasks/indicparam/indicparam_konkani.yaml' 2026-09-01T00:17:03,306 adding 'lm_eval/tasks/indicparam/indicparam_maithili.yaml' 2026-09-01T00:17:03,307 adding 'lm_eval/tasks/indicparam/indicparam_marathi.yaml' 2026-09-01T00:17:03,308 adding 'lm_eval/tasks/indicparam/indicparam_nepali.yaml' 2026-09-01T00:17:03,309 adding 'lm_eval/tasks/indicparam/indicparam_oriya.yaml' 2026-09-01T00:17:03,310 adding 'lm_eval/tasks/indicparam/indicparam_rajasthani.yaml' 2026-09-01T00:17:03,311 adding 'lm_eval/tasks/indicparam/indicparam_sanskrit.yaml' 2026-09-01T00:17:03,313 adding 'lm_eval/tasks/indicparam/indicparam_sanskrit_mix.yaml' 2026-09-01T00:17:03,314 adding 'lm_eval/tasks/indicparam/indicparam_santali.yaml' 2026-09-01T00:17:03,315 adding 'lm_eval/tasks/indicparam/utils.py' 2026-09-01T00:17:03,317 adding 'lm_eval/tasks/indicxnli/README.md' 2026-09-01T00:17:03,318 adding 'lm_eval/tasks/indicxnli/indicxnli_gu.yaml' 2026-09-01T00:17:03,321 adding 'lm_eval/tasks/infinitebench/README.md' 2026-09-01T00:17:03,322 adding 'lm_eval/tasks/infinitebench/_infinitebench_common_yaml' 2026-09-01T00:17:03,323 adding 'lm_eval/tasks/infinitebench/infinitebench.yaml' 2026-09-01T00:17:03,325 adding 'lm_eval/tasks/infinitebench/infinitebench_code_debug.yaml' 2026-09-01T00:17:03,326 adding 'lm_eval/tasks/infinitebench/infinitebench_code_run.yaml' 2026-09-01T00:17:03,328 adding 'lm_eval/tasks/infinitebench/infinitebench_kv_retrieval.yaml' 2026-09-01T00:17:03,329 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_choice_en.yaml' 2026-09-01T00:17:03,331 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_qa_chn.yaml' 2026-09-01T00:17:03,333 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_qa_en.yaml' 2026-09-01T00:17:03,334 adding 'lm_eval/tasks/infinitebench/infinitebench_longbook_sum_en.yaml' 2026-09-01T00:17:03,335 adding 'lm_eval/tasks/infinitebench/infinitebench_longdialogue_qa_en.yaml' 2026-09-01T00:17:03,336 adding 'lm_eval/tasks/infinitebench/infinitebench_math_find.yaml' 2026-09-01T00:17:03,338 adding 'lm_eval/tasks/infinitebench/infinitebench_number_string.yaml' 2026-09-01T00:17:03,339 adding 'lm_eval/tasks/infinitebench/infinitebench_passkey.yaml' 2026-09-01T00:17:03,341 adding 'lm_eval/tasks/infinitebench/utils.py' 2026-09-01T00:17:03,343 adding 'lm_eval/tasks/inverse_scaling/README.md' 2026-09-01T00:17:03,344 adding 'lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml' 2026-09-01T00:17:03,346 adding 'lm_eval/tasks/inverse_scaling/_some_results' 2026-09-01T00:17:03,347 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml' 2026-09-01T00:17:03,348 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml' 2026-09-01T00:17:03,349 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml' 2026-09-01T00:17:03,350 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml' 2026-09-01T00:17:03,351 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml' 2026-09-01T00:17:03,352 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml' 2026-09-01T00:17:03,353 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml' 2026-09-01T00:17:03,355 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml' 2026-09-01T00:17:03,356 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml' 2026-09-01T00:17:03,357 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml' 2026-09-01T00:17:03,358 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml' 2026-09-01T00:17:03,361 adding 'lm_eval/tasks/japanese_leaderboard/README.md' 2026-09-01T00:17:03,362 adding 'lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml' 2026-09-01T00:17:03,363 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml' 2026-09-01T00:17:03,364 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py' 2026-09-01T00:17:03,365 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml' 2026-09-01T00:17:03,367 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml' 2026-09-01T00:17:03,368 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml' 2026-09-01T00:17:03,369 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml' 2026-09-01T00:17:03,370 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py' 2026-09-01T00:17:03,372 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml' 2026-09-01T00:17:03,373 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py' 2026-09-01T00:17:03,374 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml' 2026-09-01T00:17:03,376 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py' 2026-09-01T00:17:03,377 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml' 2026-09-01T00:17:03,378 adding 'lm_eval/tasks/japanese_leaderboard/requirements.txt' 2026-09-01T00:17:03,380 adding 'lm_eval/tasks/jfinqa/README.md' 2026-09-01T00:17:03,381 adding 'lm_eval/tasks/jfinqa/_jfinqa.yaml' 2026-09-01T00:17:03,382 adding 'lm_eval/tasks/jfinqa/jfinqa_consistency.yaml' 2026-09-01T00:17:03,384 adding 'lm_eval/tasks/jfinqa/jfinqa_numerical.yaml' 2026-09-01T00:17:03,385 adding 'lm_eval/tasks/jfinqa/jfinqa_temporal.yaml' 2026-09-01T00:17:03,386 adding 'lm_eval/tasks/jfinqa/test_jfinqa_utils.py' 2026-09-01T00:17:03,388 adding 'lm_eval/tasks/jfinqa/utils.py' 2026-09-01T00:17:03,390 adding 'lm_eval/tasks/jsonschema_bench/README.md' 2026-09-01T00:17:03,392 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_easy.yaml' 2026-09-01T00:17:03,393 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_hard.yaml' 2026-09-01T00:17:03,394 adding 'lm_eval/tasks/jsonschema_bench/jsonschema_bench_medium.yaml' 2026-09-01T00:17:03,395 adding 'lm_eval/tasks/jsonschema_bench/metrics.py' 2026-09-01T00:17:03,398 adding 'lm_eval/tasks/kbl/README.md' 2026-09-01T00:17:03,400 adding 'lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml' 2026-09-01T00:17:03,401 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml' 2026-09-01T00:17:03,402 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml' 2026-09-01T00:17:03,403 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml' 2026-09-01T00:17:03,404 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml' 2026-09-01T00:17:03,405 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml' 2026-09-01T00:17:03,406 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml' 2026-09-01T00:17:03,408 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml' 2026-09-01T00:17:03,409 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml' 2026-09-01T00:17:03,410 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml' 2026-09-01T00:17:03,411 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml' 2026-09-01T00:17:03,412 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml' 2026-09-01T00:17:03,413 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml' 2026-09-01T00:17:03,414 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml' 2026-09-01T00:17:03,415 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2025.yaml' 2026-09-01T00:17:03,417 adding 'lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml' 2026-09-01T00:17:03,418 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml' 2026-09-01T00:17:03,419 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml' 2026-09-01T00:17:03,420 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml' 2026-09-01T00:17:03,422 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml' 2026-09-01T00:17:03,423 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml' 2026-09-01T00:17:03,424 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml' 2026-09-01T00:17:03,425 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml' 2026-09-01T00:17:03,426 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml' 2026-09-01T00:17:03,427 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml' 2026-09-01T00:17:03,428 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml' 2026-09-01T00:17:03,430 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml' 2026-09-01T00:17:03,431 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml' 2026-09-01T00:17:03,432 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml' 2026-09-01T00:17:03,434 adding 'lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml' 2026-09-01T00:17:03,435 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml' 2026-09-01T00:17:03,436 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml' 2026-09-01T00:17:03,438 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml' 2026-09-01T00:17:03,439 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml' 2026-09-01T00:17:03,440 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml' 2026-09-01T00:17:03,441 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml' 2026-09-01T00:17:03,442 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml' 2026-09-01T00:17:03,443 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml' 2026-09-01T00:17:03,445 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml' 2026-09-01T00:17:03,446 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml' 2026-09-01T00:17:03,447 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml' 2026-09-01T00:17:03,448 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml' 2026-09-01T00:17:03,449 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml' 2026-09-01T00:17:03,450 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml' 2026-09-01T00:17:03,452 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml' 2026-09-01T00:17:03,453 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml' 2026-09-01T00:17:03,454 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml' 2026-09-01T00:17:03,455 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml' 2026-09-01T00:17:03,456 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml' 2026-09-01T00:17:03,457 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml' 2026-09-01T00:17:03,458 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml' 2026-09-01T00:17:03,459 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml' 2026-09-01T00:17:03,461 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml' 2026-09-01T00:17:03,462 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml' 2026-09-01T00:17:03,463 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml' 2026-09-01T00:17:03,464 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml' 2026-09-01T00:17:03,465 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml' 2026-09-01T00:17:03,466 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml' 2026-09-01T00:17:03,468 adding 'lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml' 2026-09-01T00:17:03,469 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml' 2026-09-01T00:17:03,470 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml' 2026-09-01T00:17:03,472 adding 'lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml' 2026-09-01T00:17:03,473 adding 'lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml' 2026-09-01T00:17:03,474 adding 'lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml' 2026-09-01T00:17:03,475 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml' 2026-09-01T00:17:03,476 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml' 2026-09-01T00:17:03,478 adding 'lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml' 2026-09-01T00:17:03,480 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml' 2026-09-01T00:17:03,481 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml' 2026-09-01T00:17:03,482 adding 'lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml' 2026-09-01T00:17:03,483 adding 'lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml' 2026-09-01T00:17:03,485 adding 'lm_eval/tasks/kmmlu/README.md' 2026-09-01T00:17:03,488 adding 'lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml' 2026-09-01T00:17:03,489 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard.yaml' 2026-09-01T00:17:03,490 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_applied_science.yaml' 2026-09-01T00:17:03,491 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_humss.yaml' 2026-09-01T00:17:03,493 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_other.yaml' 2026-09-01T00:17:03,494 adding 'lm_eval/tasks/kmmlu/cot_hard/_kmmlu_cot_hard_stem.yaml' 2026-09-01T00:17:03,496 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml' 2026-09-01T00:17:03,497 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml' 2026-09-01T00:17:03,499 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:17:03,501 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml' 2026-09-01T00:17:03,503 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml' 2026-09-01T00:17:03,504 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml' 2026-09-01T00:17:03,506 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml' 2026-09-01T00:17:03,509 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml' 2026-09-01T00:17:03,510 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml' 2026-09-01T00:17:03,513 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml' 2026-09-01T00:17:03,515 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml' 2026-09-01T00:17:03,517 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml' 2026-09-01T00:17:03,519 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml' 2026-09-01T00:17:03,521 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml' 2026-09-01T00:17:03,523 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml' 2026-09-01T00:17:03,524 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml' 2026-09-01T00:17:03,526 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml' 2026-09-01T00:17:03,528 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml' 2026-09-01T00:17:03,530 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml' 2026-09-01T00:17:03,532 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml' 2026-09-01T00:17:03,533 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml' 2026-09-01T00:17:03,535 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml' 2026-09-01T00:17:03,537 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml' 2026-09-01T00:17:03,539 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml' 2026-09-01T00:17:03,541 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml' 2026-09-01T00:17:03,543 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml' 2026-09-01T00:17:03,545 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml' 2026-09-01T00:17:03,547 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml' 2026-09-01T00:17:03,549 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml' 2026-09-01T00:17:03,551 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml' 2026-09-01T00:17:03,553 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml' 2026-09-01T00:17:03,555 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml' 2026-09-01T00:17:03,557 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml' 2026-09-01T00:17:03,559 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml' 2026-09-01T00:17:03,561 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml' 2026-09-01T00:17:03,563 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml' 2026-09-01T00:17:03,565 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml' 2026-09-01T00:17:03,568 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml' 2026-09-01T00:17:03,570 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml' 2026-09-01T00:17:03,571 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml' 2026-09-01T00:17:03,573 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml' 2026-09-01T00:17:03,575 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml' 2026-09-01T00:17:03,577 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml' 2026-09-01T00:17:03,579 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml' 2026-09-01T00:17:03,581 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:17:03,584 adding 'lm_eval/tasks/kmmlu/default/_default_kmmlu_yaml' 2026-09-01T00:17:03,585 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_applied_science.yaml' 2026-09-01T00:17:03,586 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_default.yaml' 2026-09-01T00:17:03,587 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_humss.yaml' 2026-09-01T00:17:03,588 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_other.yaml' 2026-09-01T00:17:03,589 adding 'lm_eval/tasks/kmmlu/default/_kmmlu_stem.yaml' 2026-09-01T00:17:03,591 adding 'lm_eval/tasks/kmmlu/default/kmmlu_accounting.yaml' 2026-09-01T00:17:03,592 adding 'lm_eval/tasks/kmmlu/default/kmmlu_agricultural_sciences.yaml' 2026-09-01T00:17:03,593 adding 'lm_eval/tasks/kmmlu/default/kmmlu_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:17:03,594 adding 'lm_eval/tasks/kmmlu/default/kmmlu_biology.yaml' 2026-09-01T00:17:03,595 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemical_engineering.yaml' 2026-09-01T00:17:03,596 adding 'lm_eval/tasks/kmmlu/default/kmmlu_chemistry.yaml' 2026-09-01T00:17:03,597 adding 'lm_eval/tasks/kmmlu/default/kmmlu_civil_engineering.yaml' 2026-09-01T00:17:03,598 adding 'lm_eval/tasks/kmmlu/default/kmmlu_computer_science.yaml' 2026-09-01T00:17:03,600 adding 'lm_eval/tasks/kmmlu/default/kmmlu_construction.yaml' 2026-09-01T00:17:03,601 adding 'lm_eval/tasks/kmmlu/default/kmmlu_criminal_law.yaml' 2026-09-01T00:17:03,602 adding 'lm_eval/tasks/kmmlu/default/kmmlu_ecology.yaml' 2026-09-01T00:17:03,603 adding 'lm_eval/tasks/kmmlu/default/kmmlu_economics.yaml' 2026-09-01T00:17:03,604 adding 'lm_eval/tasks/kmmlu/default/kmmlu_education.yaml' 2026-09-01T00:17:03,605 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electrical_engineering.yaml' 2026-09-01T00:17:03,606 adding 'lm_eval/tasks/kmmlu/default/kmmlu_electronics_engineering.yaml' 2026-09-01T00:17:03,608 adding 'lm_eval/tasks/kmmlu/default/kmmlu_energy_management.yaml' 2026-09-01T00:17:03,609 adding 'lm_eval/tasks/kmmlu/default/kmmlu_environmental_science.yaml' 2026-09-01T00:17:03,610 adding 'lm_eval/tasks/kmmlu/default/kmmlu_fashion.yaml' 2026-09-01T00:17:03,611 adding 'lm_eval/tasks/kmmlu/default/kmmlu_food_processing.yaml' 2026-09-01T00:17:03,612 adding 'lm_eval/tasks/kmmlu/default/kmmlu_gas_technology_and_engineering.yaml' 2026-09-01T00:17:03,613 adding 'lm_eval/tasks/kmmlu/default/kmmlu_geomatics.yaml' 2026-09-01T00:17:03,614 adding 'lm_eval/tasks/kmmlu/default/kmmlu_health.yaml' 2026-09-01T00:17:03,616 adding 'lm_eval/tasks/kmmlu/default/kmmlu_industrial_engineer.yaml' 2026-09-01T00:17:03,617 adding 'lm_eval/tasks/kmmlu/default/kmmlu_information_technology.yaml' 2026-09-01T00:17:03,618 adding 'lm_eval/tasks/kmmlu/default/kmmlu_interior_architecture_and_design.yaml' 2026-09-01T00:17:03,619 adding 'lm_eval/tasks/kmmlu/default/kmmlu_korean_history.yaml' 2026-09-01T00:17:03,620 adding 'lm_eval/tasks/kmmlu/default/kmmlu_law.yaml' 2026-09-01T00:17:03,621 adding 'lm_eval/tasks/kmmlu/default/kmmlu_machine_design_and_manufacturing.yaml' 2026-09-01T00:17:03,622 adding 'lm_eval/tasks/kmmlu/default/kmmlu_management.yaml' 2026-09-01T00:17:03,624 adding 'lm_eval/tasks/kmmlu/default/kmmlu_maritime_engineering.yaml' 2026-09-01T00:17:03,625 adding 'lm_eval/tasks/kmmlu/default/kmmlu_marketing.yaml' 2026-09-01T00:17:03,626 adding 'lm_eval/tasks/kmmlu/default/kmmlu_materials_engineering.yaml' 2026-09-01T00:17:03,627 adding 'lm_eval/tasks/kmmlu/default/kmmlu_math.yaml' 2026-09-01T00:17:03,628 adding 'lm_eval/tasks/kmmlu/default/kmmlu_mechanical_engineering.yaml' 2026-09-01T00:17:03,629 adding 'lm_eval/tasks/kmmlu/default/kmmlu_nondestructive_testing.yaml' 2026-09-01T00:17:03,630 adding 'lm_eval/tasks/kmmlu/default/kmmlu_patent.yaml' 2026-09-01T00:17:03,631 adding 'lm_eval/tasks/kmmlu/default/kmmlu_political_science_and_sociology.yaml' 2026-09-01T00:17:03,633 adding 'lm_eval/tasks/kmmlu/default/kmmlu_psychology.yaml' 2026-09-01T00:17:03,634 adding 'lm_eval/tasks/kmmlu/default/kmmlu_public_safety.yaml' 2026-09-01T00:17:03,635 adding 'lm_eval/tasks/kmmlu/default/kmmlu_railway_and_automotive_engineering.yaml' 2026-09-01T00:17:03,636 adding 'lm_eval/tasks/kmmlu/default/kmmlu_real_estate.yaml' 2026-09-01T00:17:03,637 adding 'lm_eval/tasks/kmmlu/default/kmmlu_refrigerating_machinery.yaml' 2026-09-01T00:17:03,638 adding 'lm_eval/tasks/kmmlu/default/kmmlu_social_welfare.yaml' 2026-09-01T00:17:03,639 adding 'lm_eval/tasks/kmmlu/default/kmmlu_taxation.yaml' 2026-09-01T00:17:03,640 adding 'lm_eval/tasks/kmmlu/default/kmmlu_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:17:03,643 adding 'lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml' 2026-09-01T00:17:03,644 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct.yaml' 2026-09-01T00:17:03,645 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_applied_science.yaml' 2026-09-01T00:17:03,646 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_humss.yaml' 2026-09-01T00:17:03,647 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_other.yaml' 2026-09-01T00:17:03,648 adding 'lm_eval/tasks/kmmlu/direct/_kmmlu_direct_stem.yaml' 2026-09-01T00:17:03,649 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml' 2026-09-01T00:17:03,650 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml' 2026-09-01T00:17:03,652 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:17:03,653 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml' 2026-09-01T00:17:03,654 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml' 2026-09-01T00:17:03,655 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml' 2026-09-01T00:17:03,656 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml' 2026-09-01T00:17:03,657 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml' 2026-09-01T00:17:03,658 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml' 2026-09-01T00:17:03,659 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml' 2026-09-01T00:17:03,661 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml' 2026-09-01T00:17:03,662 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml' 2026-09-01T00:17:03,663 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml' 2026-09-01T00:17:03,664 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml' 2026-09-01T00:17:03,665 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml' 2026-09-01T00:17:03,666 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml' 2026-09-01T00:17:03,668 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml' 2026-09-01T00:17:03,669 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml' 2026-09-01T00:17:03,670 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml' 2026-09-01T00:17:03,671 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml' 2026-09-01T00:17:03,672 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml' 2026-09-01T00:17:03,673 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml' 2026-09-01T00:17:03,675 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml' 2026-09-01T00:17:03,676 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml' 2026-09-01T00:17:03,677 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml' 2026-09-01T00:17:03,678 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml' 2026-09-01T00:17:03,679 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml' 2026-09-01T00:17:03,680 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml' 2026-09-01T00:17:03,681 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml' 2026-09-01T00:17:03,682 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml' 2026-09-01T00:17:03,683 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml' 2026-09-01T00:17:03,684 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml' 2026-09-01T00:17:03,685 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml' 2026-09-01T00:17:03,687 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml' 2026-09-01T00:17:03,688 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml' 2026-09-01T00:17:03,689 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml' 2026-09-01T00:17:03,690 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml' 2026-09-01T00:17:03,691 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml' 2026-09-01T00:17:03,692 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml' 2026-09-01T00:17:03,693 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml' 2026-09-01T00:17:03,694 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml' 2026-09-01T00:17:03,695 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml' 2026-09-01T00:17:03,697 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml' 2026-09-01T00:17:03,698 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml' 2026-09-01T00:17:03,699 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:17:03,702 adding 'lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml' 2026-09-01T00:17:03,703 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard.yaml' 2026-09-01T00:17:03,704 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_applied_science.yaml' 2026-09-01T00:17:03,705 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_humss.yaml' 2026-09-01T00:17:03,706 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_other.yaml' 2026-09-01T00:17:03,707 adding 'lm_eval/tasks/kmmlu/direct_hard/_kmmlu_direct_hard_stem.yaml' 2026-09-01T00:17:03,708 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml' 2026-09-01T00:17:03,709 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml' 2026-09-01T00:17:03,711 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:17:03,712 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml' 2026-09-01T00:17:03,713 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml' 2026-09-01T00:17:03,714 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml' 2026-09-01T00:17:03,715 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml' 2026-09-01T00:17:03,717 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml' 2026-09-01T00:17:03,718 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml' 2026-09-01T00:17:03,719 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml' 2026-09-01T00:17:03,720 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml' 2026-09-01T00:17:03,721 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml' 2026-09-01T00:17:03,722 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml' 2026-09-01T00:17:03,723 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml' 2026-09-01T00:17:03,725 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml' 2026-09-01T00:17:03,726 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml' 2026-09-01T00:17:03,727 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml' 2026-09-01T00:17:03,728 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml' 2026-09-01T00:17:03,729 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml' 2026-09-01T00:17:03,730 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml' 2026-09-01T00:17:03,731 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml' 2026-09-01T00:17:03,732 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml' 2026-09-01T00:17:03,733 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml' 2026-09-01T00:17:03,734 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml' 2026-09-01T00:17:03,736 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml' 2026-09-01T00:17:03,737 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml' 2026-09-01T00:17:03,738 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml' 2026-09-01T00:17:03,739 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml' 2026-09-01T00:17:03,740 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml' 2026-09-01T00:17:03,741 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml' 2026-09-01T00:17:03,742 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml' 2026-09-01T00:17:03,743 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml' 2026-09-01T00:17:03,745 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml' 2026-09-01T00:17:03,746 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml' 2026-09-01T00:17:03,747 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml' 2026-09-01T00:17:03,748 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml' 2026-09-01T00:17:03,749 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml' 2026-09-01T00:17:03,751 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml' 2026-09-01T00:17:03,752 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml' 2026-09-01T00:17:03,753 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml' 2026-09-01T00:17:03,754 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml' 2026-09-01T00:17:03,755 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml' 2026-09-01T00:17:03,756 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml' 2026-09-01T00:17:03,758 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml' 2026-09-01T00:17:03,759 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:17:03,761 adding 'lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml' 2026-09-01T00:17:03,762 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard.yaml' 2026-09-01T00:17:03,764 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_applied_science.yaml' 2026-09-01T00:17:03,765 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_humss.yaml' 2026-09-01T00:17:03,766 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_other.yaml' 2026-09-01T00:17:03,767 adding 'lm_eval/tasks/kmmlu/hard/_kmmlu_hard_stem.yaml' 2026-09-01T00:17:03,768 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml' 2026-09-01T00:17:03,769 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml' 2026-09-01T00:17:03,771 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml' 2026-09-01T00:17:03,772 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml' 2026-09-01T00:17:03,773 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml' 2026-09-01T00:17:03,774 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml' 2026-09-01T00:17:03,775 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml' 2026-09-01T00:17:03,776 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml' 2026-09-01T00:17:03,777 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml' 2026-09-01T00:17:03,778 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml' 2026-09-01T00:17:03,779 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml' 2026-09-01T00:17:03,780 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml' 2026-09-01T00:17:03,781 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml' 2026-09-01T00:17:03,782 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml' 2026-09-01T00:17:03,783 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml' 2026-09-01T00:17:03,784 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml' 2026-09-01T00:17:03,786 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml' 2026-09-01T00:17:03,787 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml' 2026-09-01T00:17:03,788 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml' 2026-09-01T00:17:03,789 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml' 2026-09-01T00:17:03,790 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml' 2026-09-01T00:17:03,791 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml' 2026-09-01T00:17:03,792 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml' 2026-09-01T00:17:03,793 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml' 2026-09-01T00:17:03,794 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml' 2026-09-01T00:17:03,796 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml' 2026-09-01T00:17:03,797 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml' 2026-09-01T00:17:03,798 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml' 2026-09-01T00:17:03,799 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml' 2026-09-01T00:17:03,800 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml' 2026-09-01T00:17:03,801 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml' 2026-09-01T00:17:03,802 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml' 2026-09-01T00:17:03,803 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml' 2026-09-01T00:17:03,805 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml' 2026-09-01T00:17:03,806 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml' 2026-09-01T00:17:03,807 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml' 2026-09-01T00:17:03,808 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml' 2026-09-01T00:17:03,809 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml' 2026-09-01T00:17:03,810 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml' 2026-09-01T00:17:03,811 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml' 2026-09-01T00:17:03,812 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml' 2026-09-01T00:17:03,814 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml' 2026-09-01T00:17:03,815 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml' 2026-09-01T00:17:03,816 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml' 2026-09-01T00:17:03,817 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml' 2026-09-01T00:17:03,819 adding 'lm_eval/tasks/kobest/README.md' 2026-09-01T00:17:03,820 adding 'lm_eval/tasks/kobest/_kobest.yaml' 2026-09-01T00:17:03,821 adding 'lm_eval/tasks/kobest/kobest_boolq.yaml' 2026-09-01T00:17:03,822 adding 'lm_eval/tasks/kobest/kobest_copa.yaml' 2026-09-01T00:17:03,823 adding 'lm_eval/tasks/kobest/kobest_hellaswag.yaml' 2026-09-01T00:17:03,825 adding 'lm_eval/tasks/kobest/kobest_sentineg.yaml' 2026-09-01T00:17:03,826 adding 'lm_eval/tasks/kobest/kobest_wic.yaml' 2026-09-01T00:17:03,827 adding 'lm_eval/tasks/kobest/utils.py' 2026-09-01T00:17:03,829 adding 'lm_eval/tasks/kormedmcqa/README.md' 2026-09-01T00:17:03,830 adding 'lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml' 2026-09-01T00:17:03,831 adding 'lm_eval/tasks/kormedmcqa/_template_yaml' 2026-09-01T00:17:03,832 adding 'lm_eval/tasks/kormedmcqa/dentist.yaml' 2026-09-01T00:17:03,833 adding 'lm_eval/tasks/kormedmcqa/doctor.yaml' 2026-09-01T00:17:03,834 adding 'lm_eval/tasks/kormedmcqa/nurse.yaml' 2026-09-01T00:17:03,835 adding 'lm_eval/tasks/kormedmcqa/pharm.yaml' 2026-09-01T00:17:03,837 adding 'lm_eval/tasks/kormedmcqa/utils.py' 2026-09-01T00:17:03,838 adding 'lm_eval/tasks/lambada/README.md' 2026-09-01T00:17:03,840 adding 'lm_eval/tasks/lambada/lambada_openai.yaml' 2026-09-01T00:17:03,841 adding 'lm_eval/tasks/lambada/lambada_standard.yaml' 2026-09-01T00:17:03,843 adding 'lm_eval/tasks/lambada_cloze/README.md' 2026-09-01T00:17:03,844 adding 'lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml' 2026-09-01T00:17:03,845 adding 'lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml' 2026-09-01T00:17:03,847 adding 'lm_eval/tasks/lambada_multilingual/README.md' 2026-09-01T00:17:03,848 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml' 2026-09-01T00:17:03,849 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml' 2026-09-01T00:17:03,851 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml' 2026-09-01T00:17:03,852 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml' 2026-09-01T00:17:03,853 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml' 2026-09-01T00:17:03,855 adding 'lm_eval/tasks/lambada_multilingual_stablelm/README.md' 2026-09-01T00:17:03,856 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml' 2026-09-01T00:17:03,857 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml' 2026-09-01T00:17:03,858 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml' 2026-09-01T00:17:03,859 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml' 2026-09-01T00:17:03,860 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml' 2026-09-01T00:17:03,861 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml' 2026-09-01T00:17:03,863 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml' 2026-09-01T00:17:03,865 adding 'lm_eval/tasks/leaderboard/README.md' 2026-09-01T00:17:03,867 adding 'lm_eval/tasks/leaderboard/leaderboard.yaml' 2026-09-01T00:17:03,869 adding 'lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml' 2026-09-01T00:17:03,870 adding 'lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml' 2026-09-01T00:17:03,871 adding 'lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml' 2026-09-01T00:17:03,873 adding 'lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml' 2026-09-01T00:17:03,874 adding 'lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml' 2026-09-01T00:17:03,875 adding 'lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml' 2026-09-01T00:17:03,877 adding 'lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml' 2026-09-01T00:17:03,878 adding 'lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml' 2026-09-01T00:17:03,879 adding 'lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml' 2026-09-01T00:17:03,881 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml' 2026-09-01T00:17:03,882 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml' 2026-09-01T00:17:03,883 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml' 2026-09-01T00:17:03,884 adding 'lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml' 2026-09-01T00:17:03,886 adding 'lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml' 2026-09-01T00:17:03,887 adding 'lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml' 2026-09-01T00:17:03,888 adding 'lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml' 2026-09-01T00:17:03,889 adding 'lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml' 2026-09-01T00:17:03,890 adding 'lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml' 2026-09-01T00:17:03,892 adding 'lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml' 2026-09-01T00:17:03,893 adding 'lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml' 2026-09-01T00:17:03,894 adding 'lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml' 2026-09-01T00:17:03,895 adding 'lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml' 2026-09-01T00:17:03,897 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml' 2026-09-01T00:17:03,898 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml' 2026-09-01T00:17:03,899 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml' 2026-09-01T00:17:03,901 adding 'lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml' 2026-09-01T00:17:03,902 adding 'lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml' 2026-09-01T00:17:03,903 adding 'lm_eval/tasks/leaderboard/gpqa/_template_yaml' 2026-09-01T00:17:03,905 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml' 2026-09-01T00:17:03,906 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml' 2026-09-01T00:17:03,907 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml' 2026-09-01T00:17:03,908 adding 'lm_eval/tasks/leaderboard/gpqa/utils.py' 2026-09-01T00:17:03,910 adding 'lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml' 2026-09-01T00:17:03,911 adding 'lm_eval/tasks/leaderboard/ifeval/ifeval.yaml' 2026-09-01T00:17:03,916 adding 'lm_eval/tasks/leaderboard/ifeval/instructions.py' 2026-09-01T00:17:03,918 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_registry.py' 2026-09-01T00:17:03,921 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_util.py' 2026-09-01T00:17:03,923 adding 'lm_eval/tasks/leaderboard/ifeval/utils.py' 2026-09-01T00:17:03,925 adding 'lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml' 2026-09-01T00:17:03,926 adding 'lm_eval/tasks/leaderboard/math/_template_yaml' 2026-09-01T00:17:03,927 adding 'lm_eval/tasks/leaderboard/math/math_algebra.yaml' 2026-09-01T00:17:03,929 adding 'lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml' 2026-09-01T00:17:03,930 adding 'lm_eval/tasks/leaderboard/math/math_geometry.yaml' 2026-09-01T00:17:03,931 adding 'lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml' 2026-09-01T00:17:03,932 adding 'lm_eval/tasks/leaderboard/math/math_num_theory.yaml' 2026-09-01T00:17:03,933 adding 'lm_eval/tasks/leaderboard/math/math_prealgebra.yaml' 2026-09-01T00:17:03,934 adding 'lm_eval/tasks/leaderboard/math/math_precalculus.yaml' 2026-09-01T00:17:03,936 adding 'lm_eval/tasks/leaderboard/math/utils.py' 2026-09-01T00:17:03,938 adding 'lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml' 2026-09-01T00:17:03,939 adding 'lm_eval/tasks/leaderboard/mmlu_pro/utils.py' 2026-09-01T00:17:03,941 adding 'lm_eval/tasks/leaderboard/musr/_musr.yaml' 2026-09-01T00:17:03,942 adding 'lm_eval/tasks/leaderboard/musr/_template_yaml' 2026-09-01T00:17:03,943 adding 'lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml' 2026-09-01T00:17:03,944 adding 'lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml' 2026-09-01T00:17:03,946 adding 'lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml' 2026-09-01T00:17:03,947 adding 'lm_eval/tasks/leaderboard/musr/utils.py' 2026-09-01T00:17:03,950 adding 'lm_eval/tasks/legalbench/README.md' 2026-09-01T00:17:03,951 adding 'lm_eval/tasks/legalbench/_contract_nli.yaml' 2026-09-01T00:17:03,952 adding 'lm_eval/tasks/legalbench/_legalbench.yaml' 2026-09-01T00:17:03,953 adding 'lm_eval/tasks/legalbench/_legalbench_template_yaml' 2026-09-01T00:17:03,954 adding 'lm_eval/tasks/legalbench/abercrombie.yaml' 2026-09-01T00:17:03,955 adding 'lm_eval/tasks/legalbench/contract_nli_confidentiality_of_agreement.yaml' 2026-09-01T00:17:03,956 adding 'lm_eval/tasks/legalbench/contract_nli_explicit_identification.yaml' 2026-09-01T00:17:03,957 adding 'lm_eval/tasks/legalbench/contract_nli_inclusion_of_verbally_conveyed_information.yaml' 2026-09-01T00:17:03,958 adding 'lm_eval/tasks/legalbench/contract_nli_limited_use.yaml' 2026-09-01T00:17:03,959 adding 'lm_eval/tasks/legalbench/contract_nli_no_licensing.yaml' 2026-09-01T00:17:03,961 adding 'lm_eval/tasks/legalbench/contract_nli_notice_on_compelled_disclosure.yaml' 2026-09-01T00:17:03,962 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_acquirement_of_similar_information.yaml' 2026-09-01T00:17:03,963 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_copy.yaml' 2026-09-01T00:17:03,964 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_development_of_similar_information.yaml' 2026-09-01T00:17:03,965 adding 'lm_eval/tasks/legalbench/contract_nli_permissible_post-agreement_possession.yaml' 2026-09-01T00:17:03,967 adding 'lm_eval/tasks/legalbench/contract_nli_return_of_confidential_information.yaml' 2026-09-01T00:17:03,968 adding 'lm_eval/tasks/legalbench/contract_nli_sharing_with_employees.yaml' 2026-09-01T00:17:03,969 adding 'lm_eval/tasks/legalbench/contract_nli_sharing_with_third-parties.yaml' 2026-09-01T00:17:03,970 adding 'lm_eval/tasks/legalbench/contract_nli_survival_of_obligations.yaml' 2026-09-01T00:17:03,971 adding 'lm_eval/tasks/legalbench/corporate_lobbying.yaml' 2026-09-01T00:17:03,972 adding 'lm_eval/tasks/legalbench/function_of_decision_section.yaml' 2026-09-01T00:17:03,974 adding 'lm_eval/tasks/legalbench/international_citizenship_questions.yaml' 2026-09-01T00:17:03,975 adding 'lm_eval/tasks/legalbench/proa.yaml' 2026-09-01T00:17:03,977 adding 'lm_eval/tasks/libra/README.md' 2026-09-01T00:17:03,978 adding 'lm_eval/tasks/libra/_complex_reasoning_and_mathematical_problems.yaml' 2026-09-01T00:17:03,980 adding 'lm_eval/tasks/libra/_multi_hop_question_answering.yaml' 2026-09-01T00:17:03,981 adding 'lm_eval/tasks/libra/_question_answering_and_multiple_choice.yaml' 2026-09-01T00:17:03,982 adding 'lm_eval/tasks/libra/_simple_information_retrieval.yaml' 2026-09-01T00:17:03,983 adding 'lm_eval/tasks/libra/_template_yaml' 2026-09-01T00:17:03,984 adding 'lm_eval/tasks/libra/librusec_history.yaml' 2026-09-01T00:17:03,985 adding 'lm_eval/tasks/libra/librusec_mhqa.yaml' 2026-09-01T00:17:03,987 adding 'lm_eval/tasks/libra/long_context_multiq.yaml' 2026-09-01T00:17:03,988 adding 'lm_eval/tasks/libra/matreshka_names.yaml' 2026-09-01T00:17:03,989 adding 'lm_eval/tasks/libra/matreshka_yes_no.yaml' 2026-09-01T00:17:03,991 adding 'lm_eval/tasks/libra/passkey.yaml' 2026-09-01T00:17:03,992 adding 'lm_eval/tasks/libra/passkey_with_librusec.yaml' 2026-09-01T00:17:03,993 adding 'lm_eval/tasks/libra/ru_2wikimultihopqa.yaml' 2026-09-01T00:17:03,994 adding 'lm_eval/tasks/libra/ru_babilong_qa1.yaml' 2026-09-01T00:17:03,996 adding 'lm_eval/tasks/libra/ru_babilong_qa2.yaml' 2026-09-01T00:17:03,997 adding 'lm_eval/tasks/libra/ru_babilong_qa3.yaml' 2026-09-01T00:17:03,998 adding 'lm_eval/tasks/libra/ru_babilong_qa4.yaml' 2026-09-01T00:17:03,999 adding 'lm_eval/tasks/libra/ru_babilong_qa5.yaml' 2026-09-01T00:17:04,001 adding 'lm_eval/tasks/libra/ru_gsm100.yaml' 2026-09-01T00:17:04,002 adding 'lm_eval/tasks/libra/ru_qasper.yaml' 2026-09-01T00:17:04,003 adding 'lm_eval/tasks/libra/ru_quality.yaml' 2026-09-01T00:17:04,004 adding 'lm_eval/tasks/libra/ru_sci_abstract_retrieval.yaml' 2026-09-01T00:17:04,006 adding 'lm_eval/tasks/libra/ru_sci_passage_count.yaml' 2026-09-01T00:17:04,008 adding 'lm_eval/tasks/libra/utils.py' 2026-09-01T00:17:04,010 adding 'lm_eval/tasks/lingoly/README.md' 2026-09-01T00:17:04,011 adding 'lm_eval/tasks/lingoly/lingoly_context.yaml' 2026-09-01T00:17:04,012 adding 'lm_eval/tasks/lingoly/lingoly_group.yaml' 2026-09-01T00:17:04,014 adding 'lm_eval/tasks/lingoly/lingoly_nocontext.yaml' 2026-09-01T00:17:04,015 adding 'lm_eval/tasks/lingoly/script.py' 2026-09-01T00:17:04,017 adding 'lm_eval/tasks/lingoly/utils.py' 2026-09-01T00:17:04,019 adding 'lm_eval/tasks/llama3/README.md' 2026-09-01T00:17:04,021 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/arc_challenge_llama.yaml' 2026-09-01T00:17:04,022 adding 'lm_eval/tasks/llama3/instruct/arc_challenge/utils.py' 2026-09-01T00:17:04,024 adding 'lm_eval/tasks/llama3/instruct/gsm8k/gsm8k.yaml' 2026-09-01T00:17:04,027 adding 'lm_eval/tasks/llama3/instruct/mmlu/_continuation_template_yaml' 2026-09-01T00:17:04,028 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_humanities.yaml' 2026-09-01T00:17:04,029 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_other.yaml' 2026-09-01T00:17:04,030 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_social_sciences.yaml' 2026-09-01T00:17:04,032 adding 'lm_eval/tasks/llama3/instruct/mmlu/_mmlu_stem.yaml' 2026-09-01T00:17:04,033 adding 'lm_eval/tasks/llama3/instruct/mmlu/llama.yaml' 2026-09-01T00:17:04,034 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:04,035 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_anatomy.yaml' 2026-09-01T00:17:04,036 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_astronomy.yaml' 2026-09-01T00:17:04,037 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_business_ethics.yaml' 2026-09-01T00:17:04,038 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:04,040 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_biology.yaml' 2026-09-01T00:17:04,041 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_chemistry.yaml' 2026-09-01T00:17:04,042 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_computer_science.yaml' 2026-09-01T00:17:04,043 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_mathematics.yaml' 2026-09-01T00:17:04,044 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_medicine.yaml' 2026-09-01T00:17:04,046 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_college_physics.yaml' 2026-09-01T00:17:04,047 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_computer_security.yaml' 2026-09-01T00:17:04,048 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:04,049 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_econometrics.yaml' 2026-09-01T00:17:04,051 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:04,052 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:04,053 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_formal_logic.yaml' 2026-09-01T00:17:04,054 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_global_facts.yaml' 2026-09-01T00:17:04,056 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_biology.yaml' 2026-09-01T00:17:04,057 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:04,058 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:04,059 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:04,061 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_geography.yaml' 2026-09-01T00:17:04,062 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,063 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,064 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:04,065 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:04,067 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_physics.yaml' 2026-09-01T00:17:04,068 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:04,069 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:04,070 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:04,071 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:04,072 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_aging.yaml' 2026-09-01T00:17:04,073 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_human_sexuality.yaml' 2026-09-01T00:17:04,074 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_international_law.yaml' 2026-09-01T00:17:04,075 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_jurisprudence.yaml' 2026-09-01T00:17:04,077 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:04,078 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_machine_learning.yaml' 2026-09-01T00:17:04,079 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_management.yaml' 2026-09-01T00:17:04,080 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_marketing.yaml' 2026-09-01T00:17:04,081 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_medical_genetics.yaml' 2026-09-01T00:17:04,082 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_miscellaneous.yaml' 2026-09-01T00:17:04,083 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_disputes.yaml' 2026-09-01T00:17:04,085 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:04,086 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_nutrition.yaml' 2026-09-01T00:17:04,087 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_philosophy.yaml' 2026-09-01T00:17:04,088 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_prehistory.yaml' 2026-09-01T00:17:04,089 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_accounting.yaml' 2026-09-01T00:17:04,090 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_law.yaml' 2026-09-01T00:17:04,091 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_medicine.yaml' 2026-09-01T00:17:04,093 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_professional_psychology.yaml' 2026-09-01T00:17:04,094 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_public_relations.yaml' 2026-09-01T00:17:04,095 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_security_studies.yaml' 2026-09-01T00:17:04,097 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_sociology.yaml' 2026-09-01T00:17:04,098 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:04,099 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_virology.yaml' 2026-09-01T00:17:04,101 adding 'lm_eval/tasks/llama3/instruct/mmlu/mmlu_world_religions.yaml' 2026-09-01T00:17:04,104 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama.yaml' 2026-09-01T00:17:04,105 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_cot_llama_template_yaml' 2026-09-01T00:17:04,106 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_humanities.yaml' 2026-09-01T00:17:04,107 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_other.yaml' 2026-09-01T00:17:04,109 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_social_sciences.yaml' 2026-09-01T00:17:04,110 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/_mmlu_stem.yaml' 2026-09-01T00:17:04,111 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:04,112 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_anatomy.yaml' 2026-09-01T00:17:04,113 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_astronomy.yaml' 2026-09-01T00:17:04,115 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_business_ethics.yaml' 2026-09-01T00:17:04,116 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:04,117 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_biology.yaml' 2026-09-01T00:17:04,118 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_chemistry.yaml' 2026-09-01T00:17:04,120 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_computer_science.yaml' 2026-09-01T00:17:04,121 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_mathematics.yaml' 2026-09-01T00:17:04,122 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_medicine.yaml' 2026-09-01T00:17:04,123 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_college_physics.yaml' 2026-09-01T00:17:04,124 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_computer_security.yaml' 2026-09-01T00:17:04,126 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:04,127 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_econometrics.yaml' 2026-09-01T00:17:04,128 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:04,129 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:04,130 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_formal_logic.yaml' 2026-09-01T00:17:04,132 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_global_facts.yaml' 2026-09-01T00:17:04,133 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_biology.yaml' 2026-09-01T00:17:04,134 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:04,135 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:04,137 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:04,138 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_geography.yaml' 2026-09-01T00:17:04,139 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,140 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,141 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:04,143 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:04,144 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_physics.yaml' 2026-09-01T00:17:04,145 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:04,147 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:04,148 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:04,150 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:04,151 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_aging.yaml' 2026-09-01T00:17:04,152 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_human_sexuality.yaml' 2026-09-01T00:17:04,153 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_international_law.yaml' 2026-09-01T00:17:04,154 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_jurisprudence.yaml' 2026-09-01T00:17:04,156 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:04,157 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_machine_learning.yaml' 2026-09-01T00:17:04,158 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_management.yaml' 2026-09-01T00:17:04,159 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_marketing.yaml' 2026-09-01T00:17:04,160 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_medical_genetics.yaml' 2026-09-01T00:17:04,161 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_miscellaneous.yaml' 2026-09-01T00:17:04,163 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_disputes.yaml' 2026-09-01T00:17:04,164 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:04,165 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_nutrition.yaml' 2026-09-01T00:17:04,166 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_philosophy.yaml' 2026-09-01T00:17:04,168 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_prehistory.yaml' 2026-09-01T00:17:04,169 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_accounting.yaml' 2026-09-01T00:17:04,170 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_law.yaml' 2026-09-01T00:17:04,171 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_medicine.yaml' 2026-09-01T00:17:04,172 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_professional_psychology.yaml' 2026-09-01T00:17:04,173 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_public_relations.yaml' 2026-09-01T00:17:04,174 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_security_studies.yaml' 2026-09-01T00:17:04,175 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_sociology.yaml' 2026-09-01T00:17:04,176 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:04,177 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_virology.yaml' 2026-09-01T00:17:04,179 adding 'lm_eval/tasks/llama3/instruct/mmlu_cot/mmlu_world_religions.yaml' 2026-09-01T00:17:04,182 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_continuation_template_yaml' 2026-09-01T00:17:04,183 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_humanities.yaml' 2026-09-01T00:17:04,184 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_llama.yaml' 2026-09-01T00:17:04,185 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_other.yaml' 2026-09-01T00:17:04,186 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_social_sciences.yaml' 2026-09-01T00:17:04,188 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/_mmlu_de_stem.yaml' 2026-09-01T00:17:04,189 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_abstract_algebra.yaml' 2026-09-01T00:17:04,190 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_anatomy.yaml' 2026-09-01T00:17:04,191 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_astronomy.yaml' 2026-09-01T00:17:04,193 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_business_ethics.yaml' 2026-09-01T00:17:04,194 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_clinical_knowledge.yaml' 2026-09-01T00:17:04,196 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_biology.yaml' 2026-09-01T00:17:04,197 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_chemistry.yaml' 2026-09-01T00:17:04,198 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_computer_science.yaml' 2026-09-01T00:17:04,200 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_mathematics.yaml' 2026-09-01T00:17:04,201 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_medicine.yaml' 2026-09-01T00:17:04,202 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_college_physics.yaml' 2026-09-01T00:17:04,204 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_computer_security.yaml' 2026-09-01T00:17:04,205 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_conceptual_physics.yaml' 2026-09-01T00:17:04,207 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_econometrics.yaml' 2026-09-01T00:17:04,208 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_electrical_engineering.yaml' 2026-09-01T00:17:04,209 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_elementary_mathematics.yaml' 2026-09-01T00:17:04,211 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_formal_logic.yaml' 2026-09-01T00:17:04,212 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_global_facts.yaml' 2026-09-01T00:17:04,214 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_biology.yaml' 2026-09-01T00:17:04,215 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_chemistry.yaml' 2026-09-01T00:17:04,217 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_computer_science.yaml' 2026-09-01T00:17:04,219 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_european_history.yaml' 2026-09-01T00:17:04,221 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_geography.yaml' 2026-09-01T00:17:04,222 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,224 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,225 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_mathematics.yaml' 2026-09-01T00:17:04,226 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_microeconomics.yaml' 2026-09-01T00:17:04,228 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_physics.yaml' 2026-09-01T00:17:04,229 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_psychology.yaml' 2026-09-01T00:17:04,231 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_statistics.yaml' 2026-09-01T00:17:04,233 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_us_history.yaml' 2026-09-01T00:17:04,235 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_high_school_world_history.yaml' 2026-09-01T00:17:04,236 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_aging.yaml' 2026-09-01T00:17:04,238 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_human_sexuality.yaml' 2026-09-01T00:17:04,239 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_international_law.yaml' 2026-09-01T00:17:04,241 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_jurisprudence.yaml' 2026-09-01T00:17:04,242 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_logical_fallacies.yaml' 2026-09-01T00:17:04,243 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_machine_learning.yaml' 2026-09-01T00:17:04,245 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_management.yaml' 2026-09-01T00:17:04,246 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_marketing.yaml' 2026-09-01T00:17:04,247 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_medical_genetics.yaml' 2026-09-01T00:17:04,249 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_miscellaneous.yaml' 2026-09-01T00:17:04,250 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_disputes.yaml' 2026-09-01T00:17:04,251 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_moral_scenarios.yaml' 2026-09-01T00:17:04,253 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_nutrition.yaml' 2026-09-01T00:17:04,254 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_philosophy.yaml' 2026-09-01T00:17:04,256 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_prehistory.yaml' 2026-09-01T00:17:04,257 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_accounting.yaml' 2026-09-01T00:17:04,259 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_law.yaml' 2026-09-01T00:17:04,261 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_medicine.yaml' 2026-09-01T00:17:04,262 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_professional_psychology.yaml' 2026-09-01T00:17:04,264 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_public_relations.yaml' 2026-09-01T00:17:04,265 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_security_studies.yaml' 2026-09-01T00:17:04,267 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_sociology.yaml' 2026-09-01T00:17:04,268 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_us_foreign_policy.yaml' 2026-09-01T00:17:04,270 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_virology.yaml' 2026-09-01T00:17:04,271 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/mmlu_de_world_religions.yaml' 2026-09-01T00:17:04,272 adding 'lm_eval/tasks/llama3/instruct/mmlu_de/utils.py' 2026-09-01T00:17:04,275 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_continuation_template_yaml' 2026-09-01T00:17:04,277 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_humanities.yaml' 2026-09-01T00:17:04,278 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_llama.yaml' 2026-09-01T00:17:04,279 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_other.yaml' 2026-09-01T00:17:04,280 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_social_sciences.yaml' 2026-09-01T00:17:04,281 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/_mmlu_es_stem.yaml' 2026-09-01T00:17:04,283 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_abstract_algebra.yaml' 2026-09-01T00:17:04,284 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_anatomy.yaml' 2026-09-01T00:17:04,285 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_astronomy.yaml' 2026-09-01T00:17:04,287 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_business_ethics.yaml' 2026-09-01T00:17:04,288 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_clinical_knowledge.yaml' 2026-09-01T00:17:04,289 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_biology.yaml' 2026-09-01T00:17:04,290 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_chemistry.yaml' 2026-09-01T00:17:04,292 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_computer_science.yaml' 2026-09-01T00:17:04,293 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_mathematics.yaml' 2026-09-01T00:17:04,295 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_medicine.yaml' 2026-09-01T00:17:04,296 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_college_physics.yaml' 2026-09-01T00:17:04,297 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_computer_security.yaml' 2026-09-01T00:17:04,299 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_conceptual_physics.yaml' 2026-09-01T00:17:04,300 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_econometrics.yaml' 2026-09-01T00:17:04,301 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_electrical_engineering.yaml' 2026-09-01T00:17:04,302 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_elementary_mathematics.yaml' 2026-09-01T00:17:04,304 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_formal_logic.yaml' 2026-09-01T00:17:04,305 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_global_facts.yaml' 2026-09-01T00:17:04,307 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_biology.yaml' 2026-09-01T00:17:04,308 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_chemistry.yaml' 2026-09-01T00:17:04,309 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_computer_science.yaml' 2026-09-01T00:17:04,312 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_european_history.yaml' 2026-09-01T00:17:04,313 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_geography.yaml' 2026-09-01T00:17:04,315 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,316 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,317 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_mathematics.yaml' 2026-09-01T00:17:04,319 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_microeconomics.yaml' 2026-09-01T00:17:04,320 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_physics.yaml' 2026-09-01T00:17:04,321 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_psychology.yaml' 2026-09-01T00:17:04,323 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_statistics.yaml' 2026-09-01T00:17:04,325 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_us_history.yaml' 2026-09-01T00:17:04,327 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_high_school_world_history.yaml' 2026-09-01T00:17:04,328 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_aging.yaml' 2026-09-01T00:17:04,330 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_human_sexuality.yaml' 2026-09-01T00:17:04,331 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_international_law.yaml' 2026-09-01T00:17:04,333 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_jurisprudence.yaml' 2026-09-01T00:17:04,334 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_logical_fallacies.yaml' 2026-09-01T00:17:04,336 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_machine_learning.yaml' 2026-09-01T00:17:04,337 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_management.yaml' 2026-09-01T00:17:04,338 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_marketing.yaml' 2026-09-01T00:17:04,339 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_medical_genetics.yaml' 2026-09-01T00:17:04,341 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_miscellaneous.yaml' 2026-09-01T00:17:04,342 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_disputes.yaml' 2026-09-01T00:17:04,343 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_moral_scenarios.yaml' 2026-09-01T00:17:04,345 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_nutrition.yaml' 2026-09-01T00:17:04,346 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_philosophy.yaml' 2026-09-01T00:17:04,347 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_prehistory.yaml' 2026-09-01T00:17:04,349 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_accounting.yaml' 2026-09-01T00:17:04,351 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_law.yaml' 2026-09-01T00:17:04,352 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_medicine.yaml' 2026-09-01T00:17:04,354 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_professional_psychology.yaml' 2026-09-01T00:17:04,355 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_public_relations.yaml' 2026-09-01T00:17:04,357 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_security_studies.yaml' 2026-09-01T00:17:04,358 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_sociology.yaml' 2026-09-01T00:17:04,359 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_us_foreign_policy.yaml' 2026-09-01T00:17:04,361 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_virology.yaml' 2026-09-01T00:17:04,362 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/mmlu_es_world_religions.yaml' 2026-09-01T00:17:04,363 adding 'lm_eval/tasks/llama3/instruct/mmlu_es/utils.py' 2026-09-01T00:17:04,366 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_continuation_template_yaml' 2026-09-01T00:17:04,367 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_humanities.yaml' 2026-09-01T00:17:04,369 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_llama.yaml' 2026-09-01T00:17:04,370 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_other.yaml' 2026-09-01T00:17:04,371 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_social_sciences.yaml' 2026-09-01T00:17:04,372 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/_mmlu_fr_stem.yaml' 2026-09-01T00:17:04,373 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_abstract_algebra.yaml' 2026-09-01T00:17:04,375 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_anatomy.yaml' 2026-09-01T00:17:04,376 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_astronomy.yaml' 2026-09-01T00:17:04,378 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_business_ethics.yaml' 2026-09-01T00:17:04,379 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_clinical_knowledge.yaml' 2026-09-01T00:17:04,381 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_biology.yaml' 2026-09-01T00:17:04,382 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_chemistry.yaml' 2026-09-01T00:17:04,383 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_computer_science.yaml' 2026-09-01T00:17:04,385 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_mathematics.yaml' 2026-09-01T00:17:04,386 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_medicine.yaml' 2026-09-01T00:17:04,388 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_college_physics.yaml' 2026-09-01T00:17:04,389 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_computer_security.yaml' 2026-09-01T00:17:04,390 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_conceptual_physics.yaml' 2026-09-01T00:17:04,392 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_econometrics.yaml' 2026-09-01T00:17:04,393 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_electrical_engineering.yaml' 2026-09-01T00:17:04,395 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_elementary_mathematics.yaml' 2026-09-01T00:17:04,396 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_formal_logic.yaml' 2026-09-01T00:17:04,397 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_global_facts.yaml' 2026-09-01T00:17:04,399 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_biology.yaml' 2026-09-01T00:17:04,400 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_chemistry.yaml' 2026-09-01T00:17:04,401 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_computer_science.yaml' 2026-09-01T00:17:04,404 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_european_history.yaml' 2026-09-01T00:17:04,406 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_geography.yaml' 2026-09-01T00:17:04,407 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,408 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,410 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_mathematics.yaml' 2026-09-01T00:17:04,411 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_microeconomics.yaml' 2026-09-01T00:17:04,412 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_physics.yaml' 2026-09-01T00:17:04,414 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_psychology.yaml' 2026-09-01T00:17:04,415 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_statistics.yaml' 2026-09-01T00:17:04,418 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_us_history.yaml' 2026-09-01T00:17:04,419 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_high_school_world_history.yaml' 2026-09-01T00:17:04,421 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_aging.yaml' 2026-09-01T00:17:04,422 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_human_sexuality.yaml' 2026-09-01T00:17:04,423 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_international_law.yaml' 2026-09-01T00:17:04,425 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_jurisprudence.yaml' 2026-09-01T00:17:04,426 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_logical_fallacies.yaml' 2026-09-01T00:17:04,428 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_machine_learning.yaml' 2026-09-01T00:17:04,429 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_management.yaml' 2026-09-01T00:17:04,430 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_marketing.yaml' 2026-09-01T00:17:04,432 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_medical_genetics.yaml' 2026-09-01T00:17:04,433 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_miscellaneous.yaml' 2026-09-01T00:17:04,434 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_disputes.yaml' 2026-09-01T00:17:04,436 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_moral_scenarios.yaml' 2026-09-01T00:17:04,437 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_nutrition.yaml' 2026-09-01T00:17:04,439 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_philosophy.yaml' 2026-09-01T00:17:04,440 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_prehistory.yaml' 2026-09-01T00:17:04,442 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_accounting.yaml' 2026-09-01T00:17:04,444 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_law.yaml' 2026-09-01T00:17:04,446 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_medicine.yaml' 2026-09-01T00:17:04,447 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_professional_psychology.yaml' 2026-09-01T00:17:04,449 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_public_relations.yaml' 2026-09-01T00:17:04,450 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_security_studies.yaml' 2026-09-01T00:17:04,452 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_sociology.yaml' 2026-09-01T00:17:04,454 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_us_foreign_policy.yaml' 2026-09-01T00:17:04,455 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_virology.yaml' 2026-09-01T00:17:04,456 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/mmlu_fr_world_religions.yaml' 2026-09-01T00:17:04,458 adding 'lm_eval/tasks/llama3/instruct/mmlu_fr/utils.py' 2026-09-01T00:17:04,461 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_continuation_template_yaml' 2026-09-01T00:17:04,462 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_humanities.yaml' 2026-09-01T00:17:04,463 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_llama.yaml' 2026-09-01T00:17:04,464 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_other.yaml' 2026-09-01T00:17:04,465 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_social_sciences.yaml' 2026-09-01T00:17:04,466 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/_mmlu_hi_stem.yaml' 2026-09-01T00:17:04,468 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_abstract_algebra.yaml' 2026-09-01T00:17:04,469 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_anatomy.yaml' 2026-09-01T00:17:04,472 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_astronomy.yaml' 2026-09-01T00:17:04,474 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_business_ethics.yaml' 2026-09-01T00:17:04,475 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_clinical_knowledge.yaml' 2026-09-01T00:17:04,477 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_biology.yaml' 2026-09-01T00:17:04,479 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_chemistry.yaml' 2026-09-01T00:17:04,481 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_computer_science.yaml' 2026-09-01T00:17:04,483 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_mathematics.yaml' 2026-09-01T00:17:04,485 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_medicine.yaml' 2026-09-01T00:17:04,487 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_college_physics.yaml' 2026-09-01T00:17:04,489 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_computer_security.yaml' 2026-09-01T00:17:04,490 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_conceptual_physics.yaml' 2026-09-01T00:17:04,492 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_econometrics.yaml' 2026-09-01T00:17:04,494 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_electrical_engineering.yaml' 2026-09-01T00:17:04,496 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_elementary_mathematics.yaml' 2026-09-01T00:17:04,498 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_formal_logic.yaml' 2026-09-01T00:17:04,500 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_global_facts.yaml' 2026-09-01T00:17:04,502 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_biology.yaml' 2026-09-01T00:17:04,503 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_chemistry.yaml' 2026-09-01T00:17:04,506 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_computer_science.yaml' 2026-09-01T00:17:04,516 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_european_history.yaml' 2026-09-01T00:17:04,518 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_geography.yaml' 2026-09-01T00:17:04,520 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,522 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,524 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_mathematics.yaml' 2026-09-01T00:17:04,526 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_microeconomics.yaml' 2026-09-01T00:17:04,528 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_physics.yaml' 2026-09-01T00:17:04,530 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_psychology.yaml' 2026-09-01T00:17:04,532 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_statistics.yaml' 2026-09-01T00:17:04,540 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_us_history.yaml' 2026-09-01T00:17:04,544 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_high_school_world_history.yaml' 2026-09-01T00:17:04,546 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_aging.yaml' 2026-09-01T00:17:04,548 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_human_sexuality.yaml' 2026-09-01T00:17:04,550 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_international_law.yaml' 2026-09-01T00:17:04,552 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_jurisprudence.yaml' 2026-09-01T00:17:04,554 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_logical_fallacies.yaml' 2026-09-01T00:17:04,556 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_machine_learning.yaml' 2026-09-01T00:17:04,557 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_management.yaml' 2026-09-01T00:17:04,559 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_marketing.yaml' 2026-09-01T00:17:04,561 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_medical_genetics.yaml' 2026-09-01T00:17:04,563 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_miscellaneous.yaml' 2026-09-01T00:17:04,565 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_disputes.yaml' 2026-09-01T00:17:04,567 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_moral_scenarios.yaml' 2026-09-01T00:17:04,569 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_nutrition.yaml' 2026-09-01T00:17:04,570 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_philosophy.yaml' 2026-09-01T00:17:04,572 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_prehistory.yaml' 2026-09-01T00:17:04,575 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_accounting.yaml' 2026-09-01T00:17:04,580 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_law.yaml' 2026-09-01T00:17:04,584 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_medicine.yaml' 2026-09-01T00:17:04,586 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_professional_psychology.yaml' 2026-09-01T00:17:04,588 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_public_relations.yaml' 2026-09-01T00:17:04,592 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_security_studies.yaml' 2026-09-01T00:17:04,595 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_sociology.yaml' 2026-09-01T00:17:04,597 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_us_foreign_policy.yaml' 2026-09-01T00:17:04,598 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_virology.yaml' 2026-09-01T00:17:04,600 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/mmlu_hi_world_religions.yaml' 2026-09-01T00:17:04,602 adding 'lm_eval/tasks/llama3/instruct/mmlu_hi/utils.py' 2026-09-01T00:17:04,605 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_continuation_template_yaml' 2026-09-01T00:17:04,606 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_humanities.yaml' 2026-09-01T00:17:04,607 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_llama.yaml' 2026-09-01T00:17:04,608 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_other.yaml' 2026-09-01T00:17:04,609 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_social_sciences.yaml' 2026-09-01T00:17:04,611 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/_mmlu_it_stem.yaml' 2026-09-01T00:17:04,612 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_abstract_algebra.yaml' 2026-09-01T00:17:04,613 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_anatomy.yaml' 2026-09-01T00:17:04,615 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_astronomy.yaml' 2026-09-01T00:17:04,616 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_business_ethics.yaml' 2026-09-01T00:17:04,617 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_clinical_knowledge.yaml' 2026-09-01T00:17:04,619 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_biology.yaml' 2026-09-01T00:17:04,620 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_chemistry.yaml' 2026-09-01T00:17:04,622 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_computer_science.yaml' 2026-09-01T00:17:04,623 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_mathematics.yaml' 2026-09-01T00:17:04,624 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_medicine.yaml' 2026-09-01T00:17:04,625 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_college_physics.yaml' 2026-09-01T00:17:04,627 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_computer_security.yaml' 2026-09-01T00:17:04,628 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_conceptual_physics.yaml' 2026-09-01T00:17:04,629 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_econometrics.yaml' 2026-09-01T00:17:04,630 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_electrical_engineering.yaml' 2026-09-01T00:17:04,632 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_elementary_mathematics.yaml' 2026-09-01T00:17:04,633 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_formal_logic.yaml' 2026-09-01T00:17:04,634 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_global_facts.yaml' 2026-09-01T00:17:04,636 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_biology.yaml' 2026-09-01T00:17:04,637 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_chemistry.yaml' 2026-09-01T00:17:04,639 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_computer_science.yaml' 2026-09-01T00:17:04,641 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_european_history.yaml' 2026-09-01T00:17:04,642 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_geography.yaml' 2026-09-01T00:17:04,644 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,645 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,646 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_mathematics.yaml' 2026-09-01T00:17:04,648 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_microeconomics.yaml' 2026-09-01T00:17:04,649 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_physics.yaml' 2026-09-01T00:17:04,651 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_psychology.yaml' 2026-09-01T00:17:04,652 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_statistics.yaml' 2026-09-01T00:17:04,654 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_us_history.yaml' 2026-09-01T00:17:04,656 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_high_school_world_history.yaml' 2026-09-01T00:17:04,658 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_aging.yaml' 2026-09-01T00:17:04,659 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_human_sexuality.yaml' 2026-09-01T00:17:04,660 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_international_law.yaml' 2026-09-01T00:17:04,662 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_jurisprudence.yaml' 2026-09-01T00:17:04,663 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_logical_fallacies.yaml' 2026-09-01T00:17:04,664 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_machine_learning.yaml' 2026-09-01T00:17:04,666 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_management.yaml' 2026-09-01T00:17:04,667 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_marketing.yaml' 2026-09-01T00:17:04,668 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_medical_genetics.yaml' 2026-09-01T00:17:04,670 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_miscellaneous.yaml' 2026-09-01T00:17:04,671 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_disputes.yaml' 2026-09-01T00:17:04,672 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_moral_scenarios.yaml' 2026-09-01T00:17:04,674 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_nutrition.yaml' 2026-09-01T00:17:04,675 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_philosophy.yaml' 2026-09-01T00:17:04,677 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_prehistory.yaml' 2026-09-01T00:17:04,678 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_accounting.yaml' 2026-09-01T00:17:04,680 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_law.yaml' 2026-09-01T00:17:04,681 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_medicine.yaml' 2026-09-01T00:17:04,683 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_professional_psychology.yaml' 2026-09-01T00:17:04,684 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_public_relations.yaml' 2026-09-01T00:17:04,686 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_security_studies.yaml' 2026-09-01T00:17:04,687 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_sociology.yaml' 2026-09-01T00:17:04,688 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_us_foreign_policy.yaml' 2026-09-01T00:17:04,690 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_virology.yaml' 2026-09-01T00:17:04,691 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/mmlu_it_world_religions.yaml' 2026-09-01T00:17:04,692 adding 'lm_eval/tasks/llama3/instruct/mmlu_it/utils.py' 2026-09-01T00:17:04,695 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_default_template_yaml' 2026-09-01T00:17:04,696 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/_mmlu_pro.yaml' 2026-09-01T00:17:04,697 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_biology.yaml' 2026-09-01T00:17:04,698 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_business.yaml' 2026-09-01T00:17:04,699 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_chemistry.yaml' 2026-09-01T00:17:04,700 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_computer_science.yaml' 2026-09-01T00:17:04,701 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_economics.yaml' 2026-09-01T00:17:04,702 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_engineering.yaml' 2026-09-01T00:17:04,704 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_health.yaml' 2026-09-01T00:17:04,705 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_history.yaml' 2026-09-01T00:17:04,706 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_law.yaml' 2026-09-01T00:17:04,707 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_math.yaml' 2026-09-01T00:17:04,708 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_other.yaml' 2026-09-01T00:17:04,710 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_philosophy.yaml' 2026-09-01T00:17:04,711 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_physics.yaml' 2026-09-01T00:17:04,712 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/mmlu_pro_psychology.yaml' 2026-09-01T00:17:04,713 adding 'lm_eval/tasks/llama3/instruct/mmlu_pro/utils.py' 2026-09-01T00:17:04,716 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_continuation_template_yaml' 2026-09-01T00:17:04,717 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_humanities.yaml' 2026-09-01T00:17:04,719 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_llama.yaml' 2026-09-01T00:17:04,720 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_other.yaml' 2026-09-01T00:17:04,721 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_social_sciences.yaml' 2026-09-01T00:17:04,722 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/_mmlu_pt_stem.yaml' 2026-09-01T00:17:04,724 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_abstract_algebra.yaml' 2026-09-01T00:17:04,725 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_anatomy.yaml' 2026-09-01T00:17:04,726 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_astronomy.yaml' 2026-09-01T00:17:04,728 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_business_ethics.yaml' 2026-09-01T00:17:04,729 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_clinical_knowledge.yaml' 2026-09-01T00:17:04,731 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_biology.yaml' 2026-09-01T00:17:04,733 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_chemistry.yaml' 2026-09-01T00:17:04,735 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_computer_science.yaml' 2026-09-01T00:17:04,736 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_mathematics.yaml' 2026-09-01T00:17:04,737 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_medicine.yaml' 2026-09-01T00:17:04,738 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_college_physics.yaml' 2026-09-01T00:17:04,740 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_computer_security.yaml' 2026-09-01T00:17:04,741 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_conceptual_physics.yaml' 2026-09-01T00:17:04,742 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_econometrics.yaml' 2026-09-01T00:17:04,743 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_electrical_engineering.yaml' 2026-09-01T00:17:04,745 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_elementary_mathematics.yaml' 2026-09-01T00:17:04,746 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_formal_logic.yaml' 2026-09-01T00:17:04,748 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_global_facts.yaml' 2026-09-01T00:17:04,749 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_biology.yaml' 2026-09-01T00:17:04,750 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_chemistry.yaml' 2026-09-01T00:17:04,752 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_computer_science.yaml' 2026-09-01T00:17:04,754 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_european_history.yaml' 2026-09-01T00:17:04,756 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_geography.yaml' 2026-09-01T00:17:04,757 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,759 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,760 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_mathematics.yaml' 2026-09-01T00:17:04,761 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_microeconomics.yaml' 2026-09-01T00:17:04,762 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_physics.yaml' 2026-09-01T00:17:04,764 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_psychology.yaml' 2026-09-01T00:17:04,765 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_statistics.yaml' 2026-09-01T00:17:04,768 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_us_history.yaml' 2026-09-01T00:17:04,769 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_high_school_world_history.yaml' 2026-09-01T00:17:04,771 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_aging.yaml' 2026-09-01T00:17:04,772 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_human_sexuality.yaml' 2026-09-01T00:17:04,773 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_international_law.yaml' 2026-09-01T00:17:04,775 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_jurisprudence.yaml' 2026-09-01T00:17:04,776 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_logical_fallacies.yaml' 2026-09-01T00:17:04,777 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_machine_learning.yaml' 2026-09-01T00:17:04,779 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_management.yaml' 2026-09-01T00:17:04,780 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_marketing.yaml' 2026-09-01T00:17:04,781 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_medical_genetics.yaml' 2026-09-01T00:17:04,783 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_miscellaneous.yaml' 2026-09-01T00:17:04,784 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_disputes.yaml' 2026-09-01T00:17:04,785 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_moral_scenarios.yaml' 2026-09-01T00:17:04,787 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_nutrition.yaml' 2026-09-01T00:17:04,788 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_philosophy.yaml' 2026-09-01T00:17:04,789 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_prehistory.yaml' 2026-09-01T00:17:04,791 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_accounting.yaml' 2026-09-01T00:17:04,793 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_law.yaml' 2026-09-01T00:17:04,794 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_medicine.yaml' 2026-09-01T00:17:04,795 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_professional_psychology.yaml' 2026-09-01T00:17:04,797 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_public_relations.yaml' 2026-09-01T00:17:04,798 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_security_studies.yaml' 2026-09-01T00:17:04,800 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_sociology.yaml' 2026-09-01T00:17:04,801 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_us_foreign_policy.yaml' 2026-09-01T00:17:04,802 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_virology.yaml' 2026-09-01T00:17:04,804 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/mmlu_pt_world_religions.yaml' 2026-09-01T00:17:04,805 adding 'lm_eval/tasks/llama3/instruct/mmlu_pt/utils.py' 2026-09-01T00:17:04,808 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_continuation_template_yaml' 2026-09-01T00:17:04,809 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_humanities.yaml' 2026-09-01T00:17:04,810 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_llama.yaml' 2026-09-01T00:17:04,811 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_other.yaml' 2026-09-01T00:17:04,812 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_social_sciences.yaml' 2026-09-01T00:17:04,813 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/_mmlu_th_stem.yaml' 2026-09-01T00:17:04,815 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_abstract_algebra.yaml' 2026-09-01T00:17:04,816 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_anatomy.yaml' 2026-09-01T00:17:04,819 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_astronomy.yaml' 2026-09-01T00:17:04,821 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_business_ethics.yaml' 2026-09-01T00:17:04,822 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_clinical_knowledge.yaml' 2026-09-01T00:17:04,824 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_biology.yaml' 2026-09-01T00:17:04,826 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_chemistry.yaml' 2026-09-01T00:17:04,828 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_computer_science.yaml' 2026-09-01T00:17:04,830 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_mathematics.yaml' 2026-09-01T00:17:04,832 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_medicine.yaml' 2026-09-01T00:17:04,834 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_college_physics.yaml' 2026-09-01T00:17:04,836 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_computer_security.yaml' 2026-09-01T00:17:04,837 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_conceptual_physics.yaml' 2026-09-01T00:17:04,839 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_econometrics.yaml' 2026-09-01T00:17:04,841 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_electrical_engineering.yaml' 2026-09-01T00:17:04,842 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_elementary_mathematics.yaml' 2026-09-01T00:17:04,844 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_formal_logic.yaml' 2026-09-01T00:17:04,846 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_global_facts.yaml' 2026-09-01T00:17:04,848 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_biology.yaml' 2026-09-01T00:17:04,850 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_chemistry.yaml' 2026-09-01T00:17:04,852 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_computer_science.yaml' 2026-09-01T00:17:04,862 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_european_history.yaml' 2026-09-01T00:17:04,864 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_geography.yaml' 2026-09-01T00:17:04,866 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_government_and_politics.yaml' 2026-09-01T00:17:04,868 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_macroeconomics.yaml' 2026-09-01T00:17:04,869 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_mathematics.yaml' 2026-09-01T00:17:04,871 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_microeconomics.yaml' 2026-09-01T00:17:04,873 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_physics.yaml' 2026-09-01T00:17:04,875 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_psychology.yaml' 2026-09-01T00:17:04,877 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_statistics.yaml' 2026-09-01T00:17:04,884 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_us_history.yaml' 2026-09-01T00:17:04,889 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_high_school_world_history.yaml' 2026-09-01T00:17:04,890 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_aging.yaml' 2026-09-01T00:17:04,892 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_human_sexuality.yaml' 2026-09-01T00:17:04,894 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_international_law.yaml' 2026-09-01T00:17:04,896 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_jurisprudence.yaml' 2026-09-01T00:17:04,898 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_logical_fallacies.yaml' 2026-09-01T00:17:04,900 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_machine_learning.yaml' 2026-09-01T00:17:04,902 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_management.yaml' 2026-09-01T00:17:04,904 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_marketing.yaml' 2026-09-01T00:17:04,905 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_medical_genetics.yaml' 2026-09-01T00:17:04,907 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_miscellaneous.yaml' 2026-09-01T00:17:04,909 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_disputes.yaml' 2026-09-01T00:17:04,911 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_moral_scenarios.yaml' 2026-09-01T00:17:04,913 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_nutrition.yaml' 2026-09-01T00:17:04,914 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_philosophy.yaml' 2026-09-01T00:17:04,917 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_prehistory.yaml' 2026-09-01T00:17:04,920 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_accounting.yaml' 2026-09-01T00:17:04,928 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_law.yaml' 2026-09-01T00:17:04,931 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_medicine.yaml' 2026-09-01T00:17:04,934 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_professional_psychology.yaml' 2026-09-01T00:17:04,935 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_public_relations.yaml' 2026-09-01T00:17:04,940 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_security_studies.yaml' 2026-09-01T00:17:04,942 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_sociology.yaml' 2026-09-01T00:17:04,944 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_us_foreign_policy.yaml' 2026-09-01T00:17:04,946 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_virology.yaml' 2026-09-01T00:17:04,947 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/mmlu_th_world_religions.yaml' 2026-09-01T00:17:04,948 adding 'lm_eval/tasks/llama3/instruct/mmlu_th/utils.py' 2026-09-01T00:17:04,953 adding 'lm_eval/tasks/lm_syneval/README.md' 2026-09-01T00:17:04,954 adding 'lm_eval/tasks/lm_syneval/_template_yaml' 2026-09-01T00:17:04,955 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__plur_MS_LMV_LMV.yaml' 2026-09-01T00:17:04,957 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__long_vp_coord__sing_MS_LMV_LMV.yaml' 2026-09-01T00:17:04,958 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:17:04,959 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:17:04,960 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:17:04,961 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:17:04,962 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:17:04,963 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:17:04,964 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:17:04,965 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:17:04,966 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:17:04,968 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__plur_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:17:04,969 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_plur_ES_EV.yaml' 2026-09-01T00:17:04,970 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_anim__sing_MS_MV_sing_ES_EV.yaml' 2026-09-01T00:17:04,971 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:17:04,972 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__plur_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:17:04,973 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_plur_ES_EV.yaml' 2026-09-01T00:17:04,974 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_across_inanim__sing_IS_IV_sing_ES_EV.yaml' 2026-09-01T00:17:04,975 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:17:04,977 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:17:04,978 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:17:04,979 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:17:04,980 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:17:04,981 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:17:04,982 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:17:04,983 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_no_comp_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:17:04,984 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:17:04,986 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__plur_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:17:04,987 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_plur_MS_MV.yaml' 2026-09-01T00:17:04,988 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_anim__sing_ES_EV_sing_MS_MV.yaml' 2026-09-01T00:17:04,989 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:17:04,990 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__plur_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:17:04,991 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_plur_IS_IV.yaml' 2026-09-01T00:17:04,992 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__obj_rel_within_inanim__sing_ES_EV_sing_IS_IV.yaml' 2026-09-01T00:17:04,993 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_plur_ES.yaml' 2026-09-01T00:17:04,995 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__plur_MS_MV_sing_ES.yaml' 2026-09-01T00:17:04,996 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_plur_ES.yaml' 2026-09-01T00:17:04,997 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_anim__sing_MS_MV_sing_ES.yaml' 2026-09-01T00:17:04,998 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_plur_ES.yaml' 2026-09-01T00:17:04,999 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__plur_IS_IV_sing_ES.yaml' 2026-09-01T00:17:05,000 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_plur_ES.yaml' 2026-09-01T00:17:05,001 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__prep_inanim__sing_IS_IV_sing_ES.yaml' 2026-09-01T00:17:05,002 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_plur_BS.yaml' 2026-09-01T00:17:05,003 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__plur_MS_MV_sing_BS.yaml' 2026-09-01T00:17:05,004 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_plur_BS.yaml' 2026-09-01T00:17:05,006 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__sent_comp__sing_MS_MV_sing_BS.yaml' 2026-09-01T00:17:05,007 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__plur_MS_MV.yaml' 2026-09-01T00:17:05,008 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__simple_agrmt__sing_MS_MV.yaml' 2026-09-01T00:17:05,009 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_plur_ES.yaml' 2026-09-01T00:17:05,010 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__plur_MS_EV_MV_sing_ES.yaml' 2026-09-01T00:17:05,011 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_plur_ES.yaml' 2026-09-01T00:17:05,012 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__subj_rel__sing_MS_EV_MV_sing_ES.yaml' 2026-09-01T00:17:05,013 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__plur_MS_MV_MV.yaml' 2026-09-01T00:17:05,014 adding 'lm_eval/tasks/lm_syneval/lm_syneval__agreement__vp_coord__sing_MS_MV_MV.yaml' 2026-09-01T00:17:05,016 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__future.yaml' 2026-09-01T00:17:05,017 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_anim__past.yaml' 2026-09-01T00:17:05,018 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__future.yaml' 2026-09-01T00:17:05,019 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__npi_across_inanim__past.yaml' 2026-09-01T00:17:05,020 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__future.yaml' 2026-09-01T00:17:05,022 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_anim__past.yaml' 2026-09-01T00:17:05,023 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__future.yaml' 2026-09-01T00:17:05,024 adding 'lm_eval/tasks/lm_syneval/lm_syneval__npi__simple_npi_inanim__past.yaml' 2026-09-01T00:17:05,025 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_plur_BS.yaml' 2026-09-01T00:17:05,026 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__plur_MS_ANPHR_sing_BS.yaml' 2026-09-01T00:17:05,027 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_plur_BS.yaml' 2026-09-01T00:17:05,029 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexive_sent_comp__sing_MS_ANPHR_sing_BS.yaml' 2026-09-01T00:17:05,030 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_plur_ES_EV.yaml' 2026-09-01T00:17:05,031 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__plur_MS_ANPHR_sing_ES_EV.yaml' 2026-09-01T00:17:05,032 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_plur_ES_EV.yaml' 2026-09-01T00:17:05,033 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__reflexives_across__sing_MS_ANPHR_sing_ES_EV.yaml' 2026-09-01T00:17:05,034 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__plur_MS_ANPHR.yaml' 2026-09-01T00:17:05,035 adding 'lm_eval/tasks/lm_syneval/lm_syneval__reflexives__simple_reflexives__sing_MS_ANPHR.yaml' 2026-09-01T00:17:05,036 adding 'lm_eval/tasks/lm_syneval/lm_syneval_group.yaml' 2026-09-01T00:17:05,038 adding 'lm_eval/tasks/logiqa/README.md' 2026-09-01T00:17:05,039 adding 'lm_eval/tasks/logiqa/logiqa.yaml' 2026-09-01T00:17:05,040 adding 'lm_eval/tasks/logiqa/utils_logiqa.py' 2026-09-01T00:17:05,042 adding 'lm_eval/tasks/logiqa2/README.md' 2026-09-01T00:17:05,043 adding 'lm_eval/tasks/logiqa2/logieval.yaml' 2026-09-01T00:17:05,045 adding 'lm_eval/tasks/logiqa2/logiqa2.yaml' 2026-09-01T00:17:05,046 adding 'lm_eval/tasks/logiqa2/utils_logiqa2.py' 2026-09-01T00:17:05,048 adding 'lm_eval/tasks/longbench/2wikimqa.yaml' 2026-09-01T00:17:05,049 adding 'lm_eval/tasks/longbench/2wikimqa_e.yaml' 2026-09-01T00:17:05,051 adding 'lm_eval/tasks/longbench/README.md' 2026-09-01T00:17:05,053 adding 'lm_eval/tasks/longbench/_generate_config.py' 2026-09-01T00:17:05,054 adding 'lm_eval/tasks/longbench/_longbench.yaml' 2026-09-01T00:17:05,055 adding 'lm_eval/tasks/longbench/_longbench_code.yaml' 2026-09-01T00:17:05,056 adding 'lm_eval/tasks/longbench/_longbench_code_e.yaml' 2026-09-01T00:17:05,057 adding 'lm_eval/tasks/longbench/_longbench_e.yaml' 2026-09-01T00:17:05,059 adding 'lm_eval/tasks/longbench/_longbench_fewshot.yaml' 2026-09-01T00:17:05,060 adding 'lm_eval/tasks/longbench/_longbench_fewshot_e.yaml' 2026-09-01T00:17:05,061 adding 'lm_eval/tasks/longbench/_longbench_multi.yaml' 2026-09-01T00:17:05,062 adding 'lm_eval/tasks/longbench/_longbench_multi_e.yaml' 2026-09-01T00:17:05,063 adding 'lm_eval/tasks/longbench/_longbench_single.yaml' 2026-09-01T00:17:05,065 adding 'lm_eval/tasks/longbench/_longbench_single_e.yaml' 2026-09-01T00:17:05,066 adding 'lm_eval/tasks/longbench/_longbench_summarization.yaml' 2026-09-01T00:17:05,067 adding 'lm_eval/tasks/longbench/_longbench_summarization_e.yaml' 2026-09-01T00:17:05,068 adding 'lm_eval/tasks/longbench/_longbench_synthetic.yaml' 2026-09-01T00:17:05,069 adding 'lm_eval/tasks/longbench/_longbench_synthetic_e.yaml' 2026-09-01T00:17:05,071 adding 'lm_eval/tasks/longbench/dureader.yaml' 2026-09-01T00:17:05,072 adding 'lm_eval/tasks/longbench/gov_report.yaml' 2026-09-01T00:17:05,073 adding 'lm_eval/tasks/longbench/gov_report_e.yaml' 2026-09-01T00:17:05,074 adding 'lm_eval/tasks/longbench/hotpotqa.yaml' 2026-09-01T00:17:05,076 adding 'lm_eval/tasks/longbench/hotpotqa_e.yaml' 2026-09-01T00:17:05,077 adding 'lm_eval/tasks/longbench/lcc.yaml' 2026-09-01T00:17:05,078 adding 'lm_eval/tasks/longbench/lcc_e.yaml' 2026-09-01T00:17:05,079 adding 'lm_eval/tasks/longbench/lsht.yaml' 2026-09-01T00:17:05,081 adding 'lm_eval/tasks/longbench/metrics.py' 2026-09-01T00:17:05,083 adding 'lm_eval/tasks/longbench/multi_news.yaml' 2026-09-01T00:17:05,084 adding 'lm_eval/tasks/longbench/multi_news_e.yaml' 2026-09-01T00:17:05,085 adding 'lm_eval/tasks/longbench/multifieldqa_en.yaml' 2026-09-01T00:17:05,087 adding 'lm_eval/tasks/longbench/multifieldqa_en_e.yaml' 2026-09-01T00:17:05,088 adding 'lm_eval/tasks/longbench/multifieldqa_zh.yaml' 2026-09-01T00:17:05,089 adding 'lm_eval/tasks/longbench/musique.yaml' 2026-09-01T00:17:05,091 adding 'lm_eval/tasks/longbench/narrativeqa.yaml' 2026-09-01T00:17:05,092 adding 'lm_eval/tasks/longbench/passage_count.yaml' 2026-09-01T00:17:05,093 adding 'lm_eval/tasks/longbench/passage_count_e.yaml' 2026-09-01T00:17:05,094 adding 'lm_eval/tasks/longbench/passage_retrieval_en.yaml' 2026-09-01T00:17:05,095 adding 'lm_eval/tasks/longbench/passage_retrieval_en_e.yaml' 2026-09-01T00:17:05,097 adding 'lm_eval/tasks/longbench/passage_retrieval_zh.yaml' 2026-09-01T00:17:05,098 adding 'lm_eval/tasks/longbench/qasper.yaml' 2026-09-01T00:17:05,099 adding 'lm_eval/tasks/longbench/qasper_e.yaml' 2026-09-01T00:17:05,100 adding 'lm_eval/tasks/longbench/qmsum.yaml' 2026-09-01T00:17:05,101 adding 'lm_eval/tasks/longbench/repobench-p.yaml' 2026-09-01T00:17:05,102 adding 'lm_eval/tasks/longbench/repobench-p_e.yaml' 2026-09-01T00:17:05,104 adding 'lm_eval/tasks/longbench/samsum.yaml' 2026-09-01T00:17:05,105 adding 'lm_eval/tasks/longbench/samsum_e.yaml' 2026-09-01T00:17:05,106 adding 'lm_eval/tasks/longbench/trec.yaml' 2026-09-01T00:17:05,107 adding 'lm_eval/tasks/longbench/trec_e.yaml' 2026-09-01T00:17:05,109 adding 'lm_eval/tasks/longbench/triviaqa.yaml' 2026-09-01T00:17:05,110 adding 'lm_eval/tasks/longbench/triviaqa_e.yaml' 2026-09-01T00:17:05,111 adding 'lm_eval/tasks/longbench/utils.py' 2026-09-01T00:17:05,113 adding 'lm_eval/tasks/longbench/vcsum.yaml' 2026-09-01T00:17:05,115 adding 'lm_eval/tasks/longbench2/README.md' 2026-09-01T00:17:05,116 adding 'lm_eval/tasks/longbench2/_longbench2.yaml' 2026-09-01T00:17:05,118 adding 'lm_eval/tasks/longbench2/_longbench2_history.yaml' 2026-09-01T00:17:05,119 adding 'lm_eval/tasks/longbench2/_longbench2_incontext.yaml' 2026-09-01T00:17:05,120 adding 'lm_eval/tasks/longbench2/_longbench2_multi.yaml' 2026-09-01T00:17:05,121 adding 'lm_eval/tasks/longbench2/_longbench2_single.yaml' 2026-09-01T00:17:05,122 adding 'lm_eval/tasks/longbench2/_longbench2_structured.yaml' 2026-09-01T00:17:05,123 adding 'lm_eval/tasks/longbench2/_longbench_common_yaml' 2026-09-01T00:17:05,124 adding 'lm_eval/tasks/longbench2/academic_multi_doc.yaml' 2026-09-01T00:17:05,126 adding 'lm_eval/tasks/longbench2/academic_single.yaml' 2026-09-01T00:17:05,127 adding 'lm_eval/tasks/longbench2/agent_history.yaml' 2026-09-01T00:17:05,128 adding 'lm_eval/tasks/longbench2/detective.yaml' 2026-09-01T00:17:05,129 adding 'lm_eval/tasks/longbench2/dialogue_history.yaml' 2026-09-01T00:17:05,130 adding 'lm_eval/tasks/longbench2/event_order.yaml' 2026-09-01T00:17:05,131 adding 'lm_eval/tasks/longbench2/fin_multi_doc.yaml' 2026-09-01T00:17:05,132 adding 'lm_eval/tasks/longbench2/fin_single_doc.yaml' 2026-09-01T00:17:05,134 adding 'lm_eval/tasks/longbench2/govt_multi_doc.yaml' 2026-09-01T00:17:05,135 adding 'lm_eval/tasks/longbench2/govt_single_doc.yaml' 2026-09-01T00:17:05,136 adding 'lm_eval/tasks/longbench2/graph.yaml' 2026-09-01T00:17:05,137 adding 'lm_eval/tasks/longbench2/legal_multi.yaml' 2026-09-01T00:17:05,138 adding 'lm_eval/tasks/longbench2/legal_single.yaml' 2026-09-01T00:17:05,139 adding 'lm_eval/tasks/longbench2/lit_single_doc.yaml' 2026-09-01T00:17:05,141 adding 'lm_eval/tasks/longbench2/longbench2_code.yaml' 2026-09-01T00:17:05,142 adding 'lm_eval/tasks/longbench2/many_shot.yaml' 2026-09-01T00:17:05,143 adding 'lm_eval/tasks/longbench2/news_multi.yaml' 2026-09-01T00:17:05,144 adding 'lm_eval/tasks/longbench2/table.yaml' 2026-09-01T00:17:05,145 adding 'lm_eval/tasks/longbench2/translate.yaml' 2026-09-01T00:17:05,147 adding 'lm_eval/tasks/longbench2/user_guide.yaml' 2026-09-01T00:17:05,149 adding 'lm_eval/tasks/longproc/README.md' 2026-09-01T00:17:05,150 adding 'lm_eval/tasks/longproc/_default_yaml_0.5k' 2026-09-01T00:17:05,151 adding 'lm_eval/tasks/longproc/_default_yaml_2k' 2026-09-01T00:17:05,153 adding 'lm_eval/tasks/longproc/_default_yaml_8k' 2026-09-01T00:17:05,154 adding 'lm_eval/tasks/longproc/_longproc.yaml' 2026-09-01T00:17:05,155 adding 'lm_eval/tasks/longproc/_longproc_countdown.yaml' 2026-09-01T00:17:05,156 adding 'lm_eval/tasks/longproc/_longproc_html_to_tsv.yaml' 2026-09-01T00:17:05,157 adding 'lm_eval/tasks/longproc/_longproc_path_traversal.yaml' 2026-09-01T00:17:05,159 adding 'lm_eval/tasks/longproc/_longproc_pseudo_to_code.yaml' 2026-09-01T00:17:05,160 adding 'lm_eval/tasks/longproc/_longproc_tom_tracking.yaml' 2026-09-01T00:17:05,161 adding 'lm_eval/tasks/longproc/_longproc_travel_planning.yaml' 2026-09-01T00:17:05,162 adding 'lm_eval/tasks/longproc/countdown_0.5k.yaml' 2026-09-01T00:17:05,163 adding 'lm_eval/tasks/longproc/countdown_2k.yaml' 2026-09-01T00:17:05,164 adding 'lm_eval/tasks/longproc/countdown_8k.yaml' 2026-09-01T00:17:05,165 adding 'lm_eval/tasks/longproc/html_to_tsv_0.5k.yaml' 2026-09-01T00:17:05,166 adding 'lm_eval/tasks/longproc/html_to_tsv_2k.yaml' 2026-09-01T00:17:05,167 adding 'lm_eval/tasks/longproc/html_to_tsv_8k.yaml' 2026-09-01T00:17:05,170 adding 'lm_eval/tasks/longproc/metrics.py' 2026-09-01T00:17:05,171 adding 'lm_eval/tasks/longproc/path_traversal_0.5k.yaml' 2026-09-01T00:17:05,172 adding 'lm_eval/tasks/longproc/path_traversal_2k.yaml' 2026-09-01T00:17:05,174 adding 'lm_eval/tasks/longproc/path_traversal_8k.yaml' 2026-09-01T00:17:05,175 adding 'lm_eval/tasks/longproc/pseudo_to_code_0.5k.yaml' 2026-09-01T00:17:05,176 adding 'lm_eval/tasks/longproc/pseudo_to_code_2k.yaml' 2026-09-01T00:17:05,177 adding 'lm_eval/tasks/longproc/tom_tracking_0.5k.yaml' 2026-09-01T00:17:05,178 adding 'lm_eval/tasks/longproc/tom_tracking_2k.yaml' 2026-09-01T00:17:05,179 adding 'lm_eval/tasks/longproc/tom_tracking_8k.yaml' 2026-09-01T00:17:05,181 adding 'lm_eval/tasks/longproc/travel_planning_2k.yaml' 2026-09-01T00:17:05,182 adding 'lm_eval/tasks/longproc/travel_planning_8k.yaml' 2026-09-01T00:17:05,183 adding 'lm_eval/tasks/longproc/utils.py' 2026-09-01T00:17:05,185 adding 'lm_eval/tasks/mastermind/README.md' 2026-09-01T00:17:05,186 adding 'lm_eval/tasks/mastermind/mastermind_24_easy.yaml' 2026-09-01T00:17:05,187 adding 'lm_eval/tasks/mastermind/mastermind_24_hard.yaml' 2026-09-01T00:17:05,188 adding 'lm_eval/tasks/mastermind/mastermind_35_easy.yaml' 2026-09-01T00:17:05,189 adding 'lm_eval/tasks/mastermind/mastermind_35_hard.yaml' 2026-09-01T00:17:05,190 adding 'lm_eval/tasks/mastermind/mastermind_46_easy.yaml' 2026-09-01T00:17:05,191 adding 'lm_eval/tasks/mastermind/mastermind_46_hard.yaml' 2026-09-01T00:17:05,193 adding 'lm_eval/tasks/mathqa/README.md' 2026-09-01T00:17:05,194 adding 'lm_eval/tasks/mathqa/mathqa.yaml' 2026-09-01T00:17:05,196 adding 'lm_eval/tasks/mathqa/utils.py' 2026-09-01T00:17:05,198 adding 'lm_eval/tasks/mbpp/README.md' 2026-09-01T00:17:05,199 adding 'lm_eval/tasks/mbpp/mbpp.yaml' 2026-09-01T00:17:05,200 adding 'lm_eval/tasks/mbpp/mbpp_instruct.yaml' 2026-09-01T00:17:05,201 adding 'lm_eval/tasks/mbpp/mbpp_plus.yaml' 2026-09-01T00:17:05,202 adding 'lm_eval/tasks/mbpp/mbpp_plus_instruct.yaml' 2026-09-01T00:17:05,204 adding 'lm_eval/tasks/mbpp/utils.py' 2026-09-01T00:17:05,206 adding 'lm_eval/tasks/mc_taco/README.md' 2026-09-01T00:17:05,207 adding 'lm_eval/tasks/mc_taco/default.yaml' 2026-09-01T00:17:05,209 adding 'lm_eval/tasks/med_concepts_qa/README.md' 2026-09-01T00:17:05,211 adding 'lm_eval/tasks/med_concepts_qa/_default_template_yaml' 2026-09-01T00:17:05,212 adding 'lm_eval/tasks/med_concepts_qa/_generate_configs.py' 2026-09-01T00:17:05,213 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml' 2026-09-01T00:17:05,215 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml' 2026-09-01T00:17:05,216 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml' 2026-09-01T00:17:05,217 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml' 2026-09-01T00:17:05,218 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml' 2026-09-01T00:17:05,219 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml' 2026-09-01T00:17:05,221 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml' 2026-09-01T00:17:05,222 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml' 2026-09-01T00:17:05,223 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml' 2026-09-01T00:17:05,224 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml' 2026-09-01T00:17:05,225 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml' 2026-09-01T00:17:05,226 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml' 2026-09-01T00:17:05,227 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml' 2026-09-01T00:17:05,228 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml' 2026-09-01T00:17:05,230 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml' 2026-09-01T00:17:05,231 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml' 2026-09-01T00:17:05,232 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml' 2026-09-01T00:17:05,233 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml' 2026-09-01T00:17:05,234 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml' 2026-09-01T00:17:05,235 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml' 2026-09-01T00:17:05,236 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml' 2026-09-01T00:17:05,238 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_easy.yaml' 2026-09-01T00:17:05,239 adding 'lm_eval/tasks/med_prescriptions/med_prescriptions_hard.yaml' 2026-09-01T00:17:05,251 adding 'lm_eval/tasks/med_prescriptions/utils.py' 2026-09-01T00:17:05,253 adding 'lm_eval/tasks/med_text_classification/med_text_classification_easy.yaml' 2026-09-01T00:17:05,254 adding 'lm_eval/tasks/med_text_classification/med_text_classification_hard.yaml' 2026-09-01T00:17:05,256 adding 'lm_eval/tasks/med_text_classification/utils.py' 2026-09-01T00:17:05,258 adding 'lm_eval/tasks/meddialog/README.md' 2026-09-01T00:17:05,259 adding 'lm_eval/tasks/meddialog/meddialog_qsumm.yaml' 2026-09-01T00:17:05,261 adding 'lm_eval/tasks/meddialog/meddialog_qsumm_perplexity.yaml' 2026-09-01T00:17:05,262 adding 'lm_eval/tasks/meddialog/meddialog_raw_dialogues.yaml' 2026-09-01T00:17:05,263 adding 'lm_eval/tasks/meddialog/meddialog_raw_perplexity.yaml' 2026-09-01T00:17:05,264 adding 'lm_eval/tasks/meddialog/utils.py' 2026-09-01T00:17:05,266 adding 'lm_eval/tasks/meddialog/utils_perplexity.py' 2026-09-01T00:17:05,268 adding 'lm_eval/tasks/mediqa_qa2019/README.md' 2026-09-01T00:17:05,269 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019.yaml' 2026-09-01T00:17:05,270 adding 'lm_eval/tasks/mediqa_qa2019/mediqa_qa2019_perplexity.yaml' 2026-09-01T00:17:05,271 adding 'lm_eval/tasks/mediqa_qa2019/utils.py' 2026-09-01T00:17:05,273 adding 'lm_eval/tasks/mediqa_qa2019/utils_perplexity.py' 2026-09-01T00:17:05,274 adding 'lm_eval/tasks/medmcqa/medmcqa.yaml' 2026-09-01T00:17:05,276 adding 'lm_eval/tasks/medmcqa/utils_medmcqa.py' 2026-09-01T00:17:05,277 adding 'lm_eval/tasks/medqa/medqa.yaml' 2026-09-01T00:17:05,278 adding 'lm_eval/tasks/medqa/preprocess_medqa.py' 2026-09-01T00:17:05,280 adding 'lm_eval/tasks/medtext/README.md' 2026-09-01T00:17:05,281 adding 'lm_eval/tasks/medtext/medtext.yaml' 2026-09-01T00:17:05,283 adding 'lm_eval/tasks/medtext/medtext_perplexity.yaml' 2026-09-01T00:17:05,284 adding 'lm_eval/tasks/medtext/utils.py' 2026-09-01T00:17:05,285 adding 'lm_eval/tasks/medtext/utils_perplexity.py' 2026-09-01T00:17:05,287 adding 'lm_eval/tasks/mela/README.md' 2026-09-01T00:17:05,289 adding 'lm_eval/tasks/mela/_mela.yaml' 2026-09-01T00:17:05,291 adding 'lm_eval/tasks/mela/mela_ar.yaml' 2026-09-01T00:17:05,292 adding 'lm_eval/tasks/mela/mela_de.yaml' 2026-09-01T00:17:05,294 adding 'lm_eval/tasks/mela/mela_en.yaml' 2026-09-01T00:17:05,296 adding 'lm_eval/tasks/mela/mela_es.yaml' 2026-09-01T00:17:05,298 adding 'lm_eval/tasks/mela/mela_fr.yaml' 2026-09-01T00:17:05,300 adding 'lm_eval/tasks/mela/mela_is.yaml' 2026-09-01T00:17:05,302 adding 'lm_eval/tasks/mela/mela_it.yaml' 2026-09-01T00:17:05,303 adding 'lm_eval/tasks/mela/mela_ja.yaml' 2026-09-01T00:17:05,305 adding 'lm_eval/tasks/mela/mela_ru.yaml' 2026-09-01T00:17:05,307 adding 'lm_eval/tasks/mela/mela_zh.yaml' 2026-09-01T00:17:05,310 adding 'lm_eval/tasks/meqsum/README.md' 2026-09-01T00:17:05,311 adding 'lm_eval/tasks/meqsum/meqsum.yaml' 2026-09-01T00:17:05,313 adding 'lm_eval/tasks/meqsum/utils.py' 2026-09-01T00:17:05,317 adding 'lm_eval/tasks/metabench/README.md' 2026-09-01T00:17:05,318 adding 'lm_eval/tasks/metabench/metabench.yaml' 2026-09-01T00:17:05,320 adding 'lm_eval/tasks/metabench/metabench_arc.yaml' 2026-09-01T00:17:05,321 adding 'lm_eval/tasks/metabench/metabench_arc_permute.yaml' 2026-09-01T00:17:05,322 adding 'lm_eval/tasks/metabench/metabench_arc_secondary.yaml' 2026-09-01T00:17:05,323 adding 'lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml' 2026-09-01T00:17:05,324 adding 'lm_eval/tasks/metabench/metabench_gsm8k.yaml' 2026-09-01T00:17:05,325 adding 'lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml' 2026-09-01T00:17:05,326 adding 'lm_eval/tasks/metabench/metabench_hellaswag.yaml' 2026-09-01T00:17:05,327 adding 'lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml' 2026-09-01T00:17:05,328 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml' 2026-09-01T00:17:05,329 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml' 2026-09-01T00:17:05,330 adding 'lm_eval/tasks/metabench/metabench_mmlu.yaml' 2026-09-01T00:17:05,332 adding 'lm_eval/tasks/metabench/metabench_mmlu_permute.yaml' 2026-09-01T00:17:05,333 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml' 2026-09-01T00:17:05,334 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml' 2026-09-01T00:17:05,335 adding 'lm_eval/tasks/metabench/metabench_permute.yaml' 2026-09-01T00:17:05,336 adding 'lm_eval/tasks/metabench/metabench_secondary.yaml' 2026-09-01T00:17:05,337 adding 'lm_eval/tasks/metabench/metabench_secondary_permute.yaml' 2026-09-01T00:17:05,338 adding 'lm_eval/tasks/metabench/metabench_truthfulqa.yaml' 2026-09-01T00:17:05,339 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml' 2026-09-01T00:17:05,340 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml' 2026-09-01T00:17:05,342 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml' 2026-09-01T00:17:05,343 adding 'lm_eval/tasks/metabench/metabench_winogrande.yaml' 2026-09-01T00:17:05,344 adding 'lm_eval/tasks/metabench/metabench_winogrande_permute.yaml' 2026-09-01T00:17:05,345 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml' 2026-09-01T00:17:05,346 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml' 2026-09-01T00:17:05,348 adding 'lm_eval/tasks/metabench/process_docs.py' 2026-09-01T00:17:05,349 adding 'lm_eval/tasks/metabench/process_docs_permute.py' 2026-09-01T00:17:05,351 adding 'lm_eval/tasks/mgsm/README.md' 2026-09-01T00:17:05,352 adding 'lm_eval/tasks/mgsm/gen_yaml.sh' 2026-09-01T00:17:05,354 adding 'lm_eval/tasks/mgsm/utils.py' 2026-09-01T00:17:05,356 adding 'lm_eval/tasks/mgsm/direct/direct_yaml' 2026-09-01T00:17:05,357 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml' 2026-09-01T00:17:05,358 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml' 2026-09-01T00:17:05,360 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml' 2026-09-01T00:17:05,361 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml' 2026-09-01T00:17:05,362 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml' 2026-09-01T00:17:05,363 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml' 2026-09-01T00:17:05,364 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml' 2026-09-01T00:17:05,366 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml' 2026-09-01T00:17:05,367 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml' 2026-09-01T00:17:05,368 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml' 2026-09-01T00:17:05,369 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml' 2026-09-01T00:17:05,371 adding 'lm_eval/tasks/mgsm/en_cot/cot_yaml' 2026-09-01T00:17:05,372 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml' 2026-09-01T00:17:05,373 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml' 2026-09-01T00:17:05,374 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml' 2026-09-01T00:17:05,375 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml' 2026-09-01T00:17:05,376 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml' 2026-09-01T00:17:05,378 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml' 2026-09-01T00:17:05,379 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml' 2026-09-01T00:17:05,380 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml' 2026-09-01T00:17:05,381 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml' 2026-09-01T00:17:05,382 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml' 2026-09-01T00:17:05,383 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml' 2026-09-01T00:17:05,385 adding 'lm_eval/tasks/mgsm/native_cot/cot_yaml' 2026-09-01T00:17:05,386 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml' 2026-09-01T00:17:05,387 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml' 2026-09-01T00:17:05,389 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml' 2026-09-01T00:17:05,390 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml' 2026-09-01T00:17:05,391 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml' 2026-09-01T00:17:05,392 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml' 2026-09-01T00:17:05,393 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml' 2026-09-01T00:17:05,394 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml' 2026-09-01T00:17:05,396 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml' 2026-09-01T00:17:05,397 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml' 2026-09-01T00:17:05,398 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml' 2026-09-01T00:17:05,400 adding 'lm_eval/tasks/mimic_repsum/README.md' 2026-09-01T00:17:05,401 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum.yaml' 2026-09-01T00:17:05,403 adding 'lm_eval/tasks/mimic_repsum/mimic_repsum_perplexity.yaml' 2026-09-01T00:17:05,404 adding 'lm_eval/tasks/mimic_repsum/utils.py' 2026-09-01T00:17:05,405 adding 'lm_eval/tasks/mimic_repsum/utils_perplexity.py' 2026-09-01T00:17:05,407 adding 'lm_eval/tasks/minerva_math/README.md' 2026-09-01T00:17:05,408 adding 'lm_eval/tasks/minerva_math/minerva_math500.yaml' 2026-09-01T00:17:05,410 adding 'lm_eval/tasks/minerva_math/minerva_math_algebra.yaml' 2026-09-01T00:17:05,411 adding 'lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml' 2026-09-01T00:17:05,412 adding 'lm_eval/tasks/minerva_math/minerva_math_geometry.yaml' 2026-09-01T00:17:05,413 adding 'lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml' 2026-09-01T00:17:05,414 adding 'lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml' 2026-09-01T00:17:05,415 adding 'lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml' 2026-09-01T00:17:05,417 adding 'lm_eval/tasks/minerva_math/minerva_math_precalc.yaml' 2026-09-01T00:17:05,419 adding 'lm_eval/tasks/minerva_math/utils.py' 2026-09-01T00:17:05,421 adding 'lm_eval/tasks/mlqa/README.md' 2026-09-01T00:17:05,423 adding 'lm_eval/tasks/mlqa/generate_tasks.py' 2026-09-01T00:17:05,424 adding 'lm_eval/tasks/mlqa/mlqa_ar_ar.yaml' 2026-09-01T00:17:05,425 adding 'lm_eval/tasks/mlqa/mlqa_ar_de.yaml' 2026-09-01T00:17:05,426 adding 'lm_eval/tasks/mlqa/mlqa_ar_en.yaml' 2026-09-01T00:17:05,427 adding 'lm_eval/tasks/mlqa/mlqa_ar_es.yaml' 2026-09-01T00:17:05,429 adding 'lm_eval/tasks/mlqa/mlqa_ar_hi.yaml' 2026-09-01T00:17:05,430 adding 'lm_eval/tasks/mlqa/mlqa_ar_vi.yaml' 2026-09-01T00:17:05,431 adding 'lm_eval/tasks/mlqa/mlqa_ar_zh.yaml' 2026-09-01T00:17:05,432 adding 'lm_eval/tasks/mlqa/mlqa_common_yaml' 2026-09-01T00:17:05,433 adding 'lm_eval/tasks/mlqa/mlqa_de_ar.yaml' 2026-09-01T00:17:05,435 adding 'lm_eval/tasks/mlqa/mlqa_de_de.yaml' 2026-09-01T00:17:05,436 adding 'lm_eval/tasks/mlqa/mlqa_de_en.yaml' 2026-09-01T00:17:05,437 adding 'lm_eval/tasks/mlqa/mlqa_de_es.yaml' 2026-09-01T00:17:05,438 adding 'lm_eval/tasks/mlqa/mlqa_de_hi.yaml' 2026-09-01T00:17:05,439 adding 'lm_eval/tasks/mlqa/mlqa_de_vi.yaml' 2026-09-01T00:17:05,440 adding 'lm_eval/tasks/mlqa/mlqa_de_zh.yaml' 2026-09-01T00:17:05,441 adding 'lm_eval/tasks/mlqa/mlqa_en_ar.yaml' 2026-09-01T00:17:05,442 adding 'lm_eval/tasks/mlqa/mlqa_en_de.yaml' 2026-09-01T00:17:05,443 adding 'lm_eval/tasks/mlqa/mlqa_en_en.yaml' 2026-09-01T00:17:05,444 adding 'lm_eval/tasks/mlqa/mlqa_en_es.yaml' 2026-09-01T00:17:05,445 adding 'lm_eval/tasks/mlqa/mlqa_en_hi.yaml' 2026-09-01T00:17:05,446 adding 'lm_eval/tasks/mlqa/mlqa_en_vi.yaml' 2026-09-01T00:17:05,447 adding 'lm_eval/tasks/mlqa/mlqa_en_zh.yaml' 2026-09-01T00:17:05,448 adding 'lm_eval/tasks/mlqa/mlqa_es_ar.yaml' 2026-09-01T00:17:05,449 adding 'lm_eval/tasks/mlqa/mlqa_es_de.yaml' 2026-09-01T00:17:05,451 adding 'lm_eval/tasks/mlqa/mlqa_es_en.yaml' 2026-09-01T00:17:05,452 adding 'lm_eval/tasks/mlqa/mlqa_es_es.yaml' 2026-09-01T00:17:05,453 adding 'lm_eval/tasks/mlqa/mlqa_es_hi.yaml' 2026-09-01T00:17:05,454 adding 'lm_eval/tasks/mlqa/mlqa_es_vi.yaml' 2026-09-01T00:17:05,455 adding 'lm_eval/tasks/mlqa/mlqa_es_zh.yaml' 2026-09-01T00:17:05,457 adding 'lm_eval/tasks/mlqa/mlqa_hi_ar.yaml' 2026-09-01T00:17:05,458 adding 'lm_eval/tasks/mlqa/mlqa_hi_de.yaml' 2026-09-01T00:17:05,459 adding 'lm_eval/tasks/mlqa/mlqa_hi_en.yaml' 2026-09-01T00:17:05,460 adding 'lm_eval/tasks/mlqa/mlqa_hi_es.yaml' 2026-09-01T00:17:05,461 adding 'lm_eval/tasks/mlqa/mlqa_hi_hi.yaml' 2026-09-01T00:17:05,462 adding 'lm_eval/tasks/mlqa/mlqa_hi_vi.yaml' 2026-09-01T00:17:05,463 adding 'lm_eval/tasks/mlqa/mlqa_hi_zh.yaml' 2026-09-01T00:17:05,464 adding 'lm_eval/tasks/mlqa/mlqa_vi_ar.yaml' 2026-09-01T00:17:05,465 adding 'lm_eval/tasks/mlqa/mlqa_vi_de.yaml' 2026-09-01T00:17:05,466 adding 'lm_eval/tasks/mlqa/mlqa_vi_en.yaml' 2026-09-01T00:17:05,467 adding 'lm_eval/tasks/mlqa/mlqa_vi_es.yaml' 2026-09-01T00:17:05,469 adding 'lm_eval/tasks/mlqa/mlqa_vi_hi.yaml' 2026-09-01T00:17:05,470 adding 'lm_eval/tasks/mlqa/mlqa_vi_vi.yaml' 2026-09-01T00:17:05,471 adding 'lm_eval/tasks/mlqa/mlqa_vi_zh.yaml' 2026-09-01T00:17:05,472 adding 'lm_eval/tasks/mlqa/mlqa_zh_ar.yaml' 2026-09-01T00:17:05,473 adding 'lm_eval/tasks/mlqa/mlqa_zh_de.yaml' 2026-09-01T00:17:05,474 adding 'lm_eval/tasks/mlqa/mlqa_zh_en.yaml' 2026-09-01T00:17:05,475 adding 'lm_eval/tasks/mlqa/mlqa_zh_es.yaml' 2026-09-01T00:17:05,477 adding 'lm_eval/tasks/mlqa/mlqa_zh_hi.yaml' 2026-09-01T00:17:05,478 adding 'lm_eval/tasks/mlqa/mlqa_zh_vi.yaml' 2026-09-01T00:17:05,479 adding 'lm_eval/tasks/mlqa/mlqa_zh_zh.yaml' 2026-09-01T00:17:05,480 adding 'lm_eval/tasks/mlqa/utils.py' 2026-09-01T00:17:05,483 adding 'lm_eval/tasks/mmlu/README.md' 2026-09-01T00:17:05,484 adding 'lm_eval/tasks/mmlu/_generate_configs.py' 2026-09-01T00:17:05,487 adding 'lm_eval/tasks/mmlu/continuation/_continuation_template_yaml' 2026-09-01T00:17:05,488 adding 'lm_eval/tasks/mmlu/continuation/_mmlu.yaml' 2026-09-01T00:17:05,489 adding 'lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,490 adding 'lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml' 2026-09-01T00:17:05,492 adding 'lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml' 2026-09-01T00:17:05,493 adding 'lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,494 adding 'lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,495 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml' 2026-09-01T00:17:05,496 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,498 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,499 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,500 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,501 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml' 2026-09-01T00:17:05,502 adding 'lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml' 2026-09-01T00:17:05,503 adding 'lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,504 adding 'lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml' 2026-09-01T00:17:05,505 adding 'lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,506 adding 'lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,507 adding 'lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,508 adding 'lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml' 2026-09-01T00:17:05,509 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml' 2026-09-01T00:17:05,511 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:05,512 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:05,513 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:05,514 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml' 2026-09-01T00:17:05,515 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:05,516 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:05,517 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:05,518 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:05,519 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml' 2026-09-01T00:17:05,520 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:05,521 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:05,523 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:05,524 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:05,525 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml' 2026-09-01T00:17:05,526 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml' 2026-09-01T00:17:05,527 adding 'lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml' 2026-09-01T00:17:05,528 adding 'lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml' 2026-09-01T00:17:05,529 adding 'lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:05,531 adding 'lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml' 2026-09-01T00:17:05,532 adding 'lm_eval/tasks/mmlu/continuation/mmlu_management.yaml' 2026-09-01T00:17:05,533 adding 'lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml' 2026-09-01T00:17:05,534 adding 'lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml' 2026-09-01T00:17:05,535 adding 'lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml' 2026-09-01T00:17:05,536 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml' 2026-09-01T00:17:05,538 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:05,539 adding 'lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml' 2026-09-01T00:17:05,540 adding 'lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml' 2026-09-01T00:17:05,541 adding 'lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml' 2026-09-01T00:17:05,542 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml' 2026-09-01T00:17:05,543 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml' 2026-09-01T00:17:05,544 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml' 2026-09-01T00:17:05,546 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml' 2026-09-01T00:17:05,547 adding 'lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml' 2026-09-01T00:17:05,548 adding 'lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml' 2026-09-01T00:17:05,549 adding 'lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml' 2026-09-01T00:17:05,550 adding 'lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:05,551 adding 'lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml' 2026-09-01T00:17:05,552 adding 'lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml' 2026-09-01T00:17:05,555 adding 'lm_eval/tasks/mmlu/default/_default_template_yaml' 2026-09-01T00:17:05,556 adding 'lm_eval/tasks/mmlu/default/_mmlu.yaml' 2026-09-01T00:17:05,557 adding 'lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml' 2026-09-01T00:17:05,558 adding 'lm_eval/tasks/mmlu/default/_mmlu_other.yaml' 2026-09-01T00:17:05,559 adding 'lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml' 2026-09-01T00:17:05,561 adding 'lm_eval/tasks/mmlu/default/_mmlu_stem.yaml' 2026-09-01T00:17:05,562 adding 'lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,563 adding 'lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml' 2026-09-01T00:17:05,564 adding 'lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml' 2026-09-01T00:17:05,565 adding 'lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,566 adding 'lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,568 adding 'lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml' 2026-09-01T00:17:05,569 adding 'lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,570 adding 'lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,571 adding 'lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,572 adding 'lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,573 adding 'lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml' 2026-09-01T00:17:05,575 adding 'lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml' 2026-09-01T00:17:05,576 adding 'lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,577 adding 'lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml' 2026-09-01T00:17:05,578 adding 'lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,580 adding 'lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,581 adding 'lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,582 adding 'lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml' 2026-09-01T00:17:05,583 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml' 2026-09-01T00:17:05,584 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:05,585 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:05,587 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:05,588 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml' 2026-09-01T00:17:05,589 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:05,590 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:05,591 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:05,593 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:05,594 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml' 2026-09-01T00:17:05,595 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:05,596 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:05,597 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:05,598 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:05,600 adding 'lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml' 2026-09-01T00:17:05,601 adding 'lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml' 2026-09-01T00:17:05,602 adding 'lm_eval/tasks/mmlu/default/mmlu_international_law.yaml' 2026-09-01T00:17:05,603 adding 'lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml' 2026-09-01T00:17:05,604 adding 'lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:05,605 adding 'lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml' 2026-09-01T00:17:05,606 adding 'lm_eval/tasks/mmlu/default/mmlu_management.yaml' 2026-09-01T00:17:05,607 adding 'lm_eval/tasks/mmlu/default/mmlu_marketing.yaml' 2026-09-01T00:17:05,608 adding 'lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml' 2026-09-01T00:17:05,609 adding 'lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml' 2026-09-01T00:17:05,610 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml' 2026-09-01T00:17:05,611 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:05,613 adding 'lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml' 2026-09-01T00:17:05,614 adding 'lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml' 2026-09-01T00:17:05,615 adding 'lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml' 2026-09-01T00:17:05,616 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml' 2026-09-01T00:17:05,617 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml' 2026-09-01T00:17:05,618 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml' 2026-09-01T00:17:05,619 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml' 2026-09-01T00:17:05,620 adding 'lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml' 2026-09-01T00:17:05,621 adding 'lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml' 2026-09-01T00:17:05,623 adding 'lm_eval/tasks/mmlu/default/mmlu_sociology.yaml' 2026-09-01T00:17:05,624 adding 'lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:05,625 adding 'lm_eval/tasks/mmlu/default/mmlu_virology.yaml' 2026-09-01T00:17:05,626 adding 'lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml' 2026-09-01T00:17:05,666 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json' 2026-09-01T00:17:05,668 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml' 2026-09-01T00:17:05,670 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml' 2026-09-01T00:17:05,671 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,673 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml' 2026-09-01T00:17:05,674 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml' 2026-09-01T00:17:05,676 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,677 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,678 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml' 2026-09-01T00:17:05,680 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,681 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,683 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,684 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,686 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml' 2026-09-01T00:17:05,687 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml' 2026-09-01T00:17:05,689 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,690 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml' 2026-09-01T00:17:05,692 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,693 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,695 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,697 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml' 2026-09-01T00:17:05,699 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml' 2026-09-01T00:17:05,700 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:05,702 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:05,705 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:05,706 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml' 2026-09-01T00:17:05,708 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:05,709 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:05,711 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:05,712 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:05,714 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml' 2026-09-01T00:17:05,715 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:05,717 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:05,719 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:05,721 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:05,722 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml' 2026-09-01T00:17:05,724 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml' 2026-09-01T00:17:05,725 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml' 2026-09-01T00:17:05,728 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml' 2026-09-01T00:17:05,730 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:05,731 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml' 2026-09-01T00:17:05,733 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml' 2026-09-01T00:17:05,734 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml' 2026-09-01T00:17:05,736 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml' 2026-09-01T00:17:05,737 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml' 2026-09-01T00:17:05,738 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml' 2026-09-01T00:17:05,740 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:05,741 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml' 2026-09-01T00:17:05,743 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml' 2026-09-01T00:17:05,744 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml' 2026-09-01T00:17:05,746 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml' 2026-09-01T00:17:05,747 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml' 2026-09-01T00:17:05,749 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml' 2026-09-01T00:17:05,751 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml' 2026-09-01T00:17:05,752 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml' 2026-09-01T00:17:05,754 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml' 2026-09-01T00:17:05,755 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml' 2026-09-01T00:17:05,757 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:05,758 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml' 2026-09-01T00:17:05,760 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml' 2026-09-01T00:17:05,762 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml' 2026-09-01T00:17:05,763 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml' 2026-09-01T00:17:05,765 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,766 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml' 2026-09-01T00:17:05,767 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml' 2026-09-01T00:17:05,768 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,769 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,770 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml' 2026-09-01T00:17:05,772 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,773 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,774 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,775 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,776 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml' 2026-09-01T00:17:05,777 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml' 2026-09-01T00:17:05,778 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,780 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml' 2026-09-01T00:17:05,781 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,782 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,783 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,784 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml' 2026-09-01T00:17:05,785 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml' 2026-09-01T00:17:05,786 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:05,787 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:05,789 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:05,790 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml' 2026-09-01T00:17:05,791 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:05,792 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:05,793 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:05,795 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:05,796 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml' 2026-09-01T00:17:05,797 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:05,798 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:05,799 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:05,800 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:05,802 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml' 2026-09-01T00:17:05,803 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml' 2026-09-01T00:17:05,804 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml' 2026-09-01T00:17:05,805 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml' 2026-09-01T00:17:05,807 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:05,808 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml' 2026-09-01T00:17:05,809 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml' 2026-09-01T00:17:05,810 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml' 2026-09-01T00:17:05,811 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml' 2026-09-01T00:17:05,812 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml' 2026-09-01T00:17:05,814 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml' 2026-09-01T00:17:05,815 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:05,816 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml' 2026-09-01T00:17:05,817 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml' 2026-09-01T00:17:05,818 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml' 2026-09-01T00:17:05,820 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml' 2026-09-01T00:17:05,821 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml' 2026-09-01T00:17:05,822 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml' 2026-09-01T00:17:05,823 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml' 2026-09-01T00:17:05,824 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml' 2026-09-01T00:17:05,825 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml' 2026-09-01T00:17:05,826 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml' 2026-09-01T00:17:05,827 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:05,828 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml' 2026-09-01T00:17:05,830 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml' 2026-09-01T00:17:05,831 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py' 2026-09-01T00:17:05,834 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml' 2026-09-01T00:17:05,835 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml' 2026-09-01T00:17:05,836 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,838 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml' 2026-09-01T00:17:05,839 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml' 2026-09-01T00:17:05,840 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,841 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,842 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml' 2026-09-01T00:17:05,843 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,845 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,846 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,847 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,848 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml' 2026-09-01T00:17:05,849 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml' 2026-09-01T00:17:05,851 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,852 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml' 2026-09-01T00:17:05,853 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,854 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,856 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,857 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml' 2026-09-01T00:17:05,858 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:17:05,859 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:05,860 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:05,862 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:05,863 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:17:05,864 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:05,865 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:05,866 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:05,867 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:05,869 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:17:05,870 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:05,871 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:05,872 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:05,873 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:05,874 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml' 2026-09-01T00:17:05,876 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:17:05,877 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml' 2026-09-01T00:17:05,878 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:17:05,879 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:05,880 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml' 2026-09-01T00:17:05,881 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml' 2026-09-01T00:17:05,883 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml' 2026-09-01T00:17:05,884 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:17:05,885 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:17:05,886 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:17:05,887 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:05,889 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml' 2026-09-01T00:17:05,890 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml' 2026-09-01T00:17:05,891 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml' 2026-09-01T00:17:05,892 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:17:05,893 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml' 2026-09-01T00:17:05,894 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:17:05,896 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:17:05,897 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml' 2026-09-01T00:17:05,898 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml' 2026-09-01T00:17:05,899 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml' 2026-09-01T00:17:05,900 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:05,901 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml' 2026-09-01T00:17:05,903 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml' 2026-09-01T00:17:05,904 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py' 2026-09-01T00:17:05,907 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml' 2026-09-01T00:17:05,908 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml' 2026-09-01T00:17:05,909 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,910 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml' 2026-09-01T00:17:05,912 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml' 2026-09-01T00:17:05,913 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,914 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,915 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml' 2026-09-01T00:17:05,916 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,917 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,919 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,920 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,921 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml' 2026-09-01T00:17:05,922 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml' 2026-09-01T00:17:05,923 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,924 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml' 2026-09-01T00:17:05,926 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,927 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,928 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,929 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml' 2026-09-01T00:17:05,930 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml' 2026-09-01T00:17:05,931 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:05,932 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:05,934 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:05,935 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml' 2026-09-01T00:17:05,936 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:05,937 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:05,938 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:05,939 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:05,941 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml' 2026-09-01T00:17:05,942 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:05,943 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:05,944 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:05,945 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:05,947 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml' 2026-09-01T00:17:05,948 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml' 2026-09-01T00:17:05,949 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml' 2026-09-01T00:17:05,950 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml' 2026-09-01T00:17:05,951 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:05,953 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml' 2026-09-01T00:17:05,954 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml' 2026-09-01T00:17:05,955 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml' 2026-09-01T00:17:05,956 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml' 2026-09-01T00:17:05,957 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml' 2026-09-01T00:17:05,958 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml' 2026-09-01T00:17:05,959 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:05,960 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml' 2026-09-01T00:17:05,961 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml' 2026-09-01T00:17:05,962 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml' 2026-09-01T00:17:05,963 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml' 2026-09-01T00:17:05,964 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml' 2026-09-01T00:17:05,966 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml' 2026-09-01T00:17:05,967 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml' 2026-09-01T00:17:05,968 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml' 2026-09-01T00:17:05,969 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml' 2026-09-01T00:17:05,970 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml' 2026-09-01T00:17:05,971 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:05,972 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml' 2026-09-01T00:17:05,974 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml' 2026-09-01T00:17:05,976 adding 'lm_eval/tasks/mmlu/generative/_default_template_yaml' 2026-09-01T00:17:05,977 adding 'lm_eval/tasks/mmlu/generative/_mmlu.yaml' 2026-09-01T00:17:05,978 adding 'lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:05,980 adding 'lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml' 2026-09-01T00:17:05,981 adding 'lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml' 2026-09-01T00:17:05,982 adding 'lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml' 2026-09-01T00:17:05,983 adding 'lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:05,984 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml' 2026-09-01T00:17:05,985 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:17:05,987 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:17:05,988 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:17:05,989 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml' 2026-09-01T00:17:05,990 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml' 2026-09-01T00:17:05,991 adding 'lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml' 2026-09-01T00:17:05,992 adding 'lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:05,994 adding 'lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml' 2026-09-01T00:17:05,995 adding 'lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:05,996 adding 'lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:05,997 adding 'lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml' 2026-09-01T00:17:05,999 adding 'lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml' 2026-09-01T00:17:06,000 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:17:06,001 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:06,002 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:06,003 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:06,005 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:17:06,006 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:06,007 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:06,008 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:06,009 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:06,011 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:17:06,012 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:06,013 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:06,014 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:06,015 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:06,016 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml' 2026-09-01T00:17:06,018 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:17:06,019 adding 'lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml' 2026-09-01T00:17:06,020 adding 'lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:17:06,021 adding 'lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:06,022 adding 'lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml' 2026-09-01T00:17:06,023 adding 'lm_eval/tasks/mmlu/generative/mmlu_management.yaml' 2026-09-01T00:17:06,025 adding 'lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml' 2026-09-01T00:17:06,026 adding 'lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:17:06,027 adding 'lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:17:06,028 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:17:06,029 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:06,030 adding 'lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml' 2026-09-01T00:17:06,032 adding 'lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml' 2026-09-01T00:17:06,033 adding 'lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml' 2026-09-01T00:17:06,034 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:17:06,035 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml' 2026-09-01T00:17:06,036 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:17:06,038 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:17:06,039 adding 'lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml' 2026-09-01T00:17:06,040 adding 'lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml' 2026-09-01T00:17:06,042 adding 'lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml' 2026-09-01T00:17:06,043 adding 'lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:06,044 adding 'lm_eval/tasks/mmlu/generative/mmlu_virology.yaml' 2026-09-01T00:17:06,045 adding 'lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml' 2026-09-01T00:17:06,048 adding 'lm_eval/tasks/mmlu-pro-plus/README.md' 2026-09-01T00:17:06,049 adding 'lm_eval/tasks/mmlu-pro-plus/_default_template_yaml' 2026-09-01T00:17:06,050 adding 'lm_eval/tasks/mmlu-pro-plus/_mmlu_pro_plus.yaml' 2026-09-01T00:17:06,052 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_biology.yaml' 2026-09-01T00:17:06,053 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_business.yaml' 2026-09-01T00:17:06,055 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_chemistry.yaml' 2026-09-01T00:17:06,057 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_computer_science.yaml' 2026-09-01T00:17:06,059 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_economics.yaml' 2026-09-01T00:17:06,061 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_engineering.yaml' 2026-09-01T00:17:06,063 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_health.yaml' 2026-09-01T00:17:06,064 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_history.yaml' 2026-09-01T00:17:06,065 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_law.yaml' 2026-09-01T00:17:06,066 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_math.yaml' 2026-09-01T00:17:06,067 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_other.yaml' 2026-09-01T00:17:06,069 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_philosophy.yaml' 2026-09-01T00:17:06,070 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_physics.yaml' 2026-09-01T00:17:06,071 adding 'lm_eval/tasks/mmlu-pro-plus/mmlu_pro_plus_psychology.yaml' 2026-09-01T00:17:06,072 adding 'lm_eval/tasks/mmlu-pro-plus/utils.py' 2026-09-01T00:17:06,076 adding 'lm_eval/tasks/mmlu-redux/generative/README.md' 2026-09-01T00:17:06,077 adding 'lm_eval/tasks/mmlu-redux/generative/_default_template_yaml' 2026-09-01T00:17:06,078 adding 'lm_eval/tasks/mmlu-redux/generative/_mmlu.yaml' 2026-09-01T00:17:06,080 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:06,081 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_anatomy.yaml' 2026-09-01T00:17:06,082 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_astronomy.yaml' 2026-09-01T00:17:06,083 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_business_ethics.yaml' 2026-09-01T00:17:06,084 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:06,086 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_biology.yaml' 2026-09-01T00:17:06,087 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:17:06,088 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:17:06,089 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:17:06,090 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_medicine.yaml' 2026-09-01T00:17:06,091 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_college_physics.yaml' 2026-09-01T00:17:06,093 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_computer_security.yaml' 2026-09-01T00:17:06,094 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:06,095 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_econometrics.yaml' 2026-09-01T00:17:06,096 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:06,097 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:06,098 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_formal_logic.yaml' 2026-09-01T00:17:06,100 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_global_facts.yaml' 2026-09-01T00:17:06,101 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:17:06,102 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:06,103 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:06,104 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:06,106 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:17:06,107 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:06,108 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:06,109 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:06,110 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:06,111 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:17:06,113 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:06,114 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:06,115 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:06,116 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:06,117 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_aging.yaml' 2026-09-01T00:17:06,119 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:17:06,120 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_international_law.yaml' 2026-09-01T00:17:06,121 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:17:06,122 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:06,123 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_machine_learning.yaml' 2026-09-01T00:17:06,124 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_management.yaml' 2026-09-01T00:17:06,125 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_marketing.yaml' 2026-09-01T00:17:06,127 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:17:06,128 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:17:06,129 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:17:06,130 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:06,131 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_nutrition.yaml' 2026-09-01T00:17:06,133 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_philosophy.yaml' 2026-09-01T00:17:06,134 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_prehistory.yaml' 2026-09-01T00:17:06,135 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:17:06,136 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_law.yaml' 2026-09-01T00:17:06,137 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:17:06,138 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:17:06,140 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_public_relations.yaml' 2026-09-01T00:17:06,141 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_security_studies.yaml' 2026-09-01T00:17:06,142 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_sociology.yaml' 2026-09-01T00:17:06,143 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:06,144 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_virology.yaml' 2026-09-01T00:17:06,146 adding 'lm_eval/tasks/mmlu-redux/generative/mmlu_world_religions.yaml' 2026-09-01T00:17:06,147 adding 'lm_eval/tasks/mmlu-redux-spanish/README.md' 2026-09-01T00:17:06,149 adding 'lm_eval/tasks/mmlu-redux-spanish/mmlu-redux-2.0-spanish.yaml' 2026-09-01T00:17:06,151 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_default_template_spanish_yaml' 2026-09-01T00:17:06,152 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/_mmlu.yaml' 2026-09-01T00:17:06,154 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_abstract_algebra.yaml' 2026-09-01T00:17:06,155 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_anatomy.yaml' 2026-09-01T00:17:06,156 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_astronomy.yaml' 2026-09-01T00:17:06,157 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_business_ethics.yaml' 2026-09-01T00:17:06,159 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_clinical_knowledge.yaml' 2026-09-01T00:17:06,160 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_biology.yaml' 2026-09-01T00:17:06,161 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_chemistry.yaml' 2026-09-01T00:17:06,162 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_computer_science.yaml' 2026-09-01T00:17:06,163 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_mathematics.yaml' 2026-09-01T00:17:06,165 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_medicine.yaml' 2026-09-01T00:17:06,166 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_college_physics.yaml' 2026-09-01T00:17:06,167 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_computer_security.yaml' 2026-09-01T00:17:06,168 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_conceptual_physics.yaml' 2026-09-01T00:17:06,169 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_econometrics.yaml' 2026-09-01T00:17:06,170 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_electrical_engineering.yaml' 2026-09-01T00:17:06,172 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_elementary_mathematics.yaml' 2026-09-01T00:17:06,173 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_formal_logic.yaml' 2026-09-01T00:17:06,174 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_global_facts.yaml' 2026-09-01T00:17:06,175 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_biology.yaml' 2026-09-01T00:17:06,176 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_chemistry.yaml' 2026-09-01T00:17:06,177 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_computer_science.yaml' 2026-09-01T00:17:06,179 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_european_history.yaml' 2026-09-01T00:17:06,180 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_geography.yaml' 2026-09-01T00:17:06,181 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_government_and_politics.yaml' 2026-09-01T00:17:06,182 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_macroeconomics.yaml' 2026-09-01T00:17:06,183 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_mathematics.yaml' 2026-09-01T00:17:06,184 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_microeconomics.yaml' 2026-09-01T00:17:06,185 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_physics.yaml' 2026-09-01T00:17:06,187 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_psychology.yaml' 2026-09-01T00:17:06,188 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_statistics.yaml' 2026-09-01T00:17:06,189 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_us_history.yaml' 2026-09-01T00:17:06,190 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_high_school_world_history.yaml' 2026-09-01T00:17:06,191 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_aging.yaml' 2026-09-01T00:17:06,192 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_human_sexuality.yaml' 2026-09-01T00:17:06,193 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_international_law.yaml' 2026-09-01T00:17:06,195 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_jurisprudence.yaml' 2026-09-01T00:17:06,196 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_logical_fallacies.yaml' 2026-09-01T00:17:06,197 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_machine_learning.yaml' 2026-09-01T00:17:06,198 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_management.yaml' 2026-09-01T00:17:06,199 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_marketing.yaml' 2026-09-01T00:17:06,201 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_medical_genetics.yaml' 2026-09-01T00:17:06,202 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_miscellaneous.yaml' 2026-09-01T00:17:06,203 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_disputes.yaml' 2026-09-01T00:17:06,204 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_moral_scenarios.yaml' 2026-09-01T00:17:06,205 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_nutrition.yaml' 2026-09-01T00:17:06,207 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_philosophy.yaml' 2026-09-01T00:17:06,208 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_prehistory.yaml' 2026-09-01T00:17:06,209 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_accounting.yaml' 2026-09-01T00:17:06,210 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_law.yaml' 2026-09-01T00:17:06,211 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_medicine.yaml' 2026-09-01T00:17:06,213 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_professional_psychology.yaml' 2026-09-01T00:17:06,214 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_public_relations.yaml' 2026-09-01T00:17:06,215 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_security_studies.yaml' 2026-09-01T00:17:06,216 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_sociology.yaml' 2026-09-01T00:17:06,217 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_us_foreign_policy.yaml' 2026-09-01T00:17:06,218 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_virology.yaml' 2026-09-01T00:17:06,219 adding 'lm_eval/tasks/mmlu-redux-spanish/generative/mmlu_world_religions.yaml' 2026-09-01T00:17:06,221 adding 'lm_eval/tasks/mmlu_pro/README.md' 2026-09-01T00:17:06,222 adding 'lm_eval/tasks/mmlu_pro/_default_template_yaml' 2026-09-01T00:17:06,224 adding 'lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml' 2026-09-01T00:17:06,225 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml' 2026-09-01T00:17:06,226 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml' 2026-09-01T00:17:06,227 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml' 2026-09-01T00:17:06,228 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml' 2026-09-01T00:17:06,230 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml' 2026-09-01T00:17:06,231 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml' 2026-09-01T00:17:06,232 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml' 2026-09-01T00:17:06,233 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml' 2026-09-01T00:17:06,235 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml' 2026-09-01T00:17:06,236 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml' 2026-09-01T00:17:06,237 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml' 2026-09-01T00:17:06,238 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml' 2026-09-01T00:17:06,239 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml' 2026-09-01T00:17:06,241 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml' 2026-09-01T00:17:06,242 adding 'lm_eval/tasks/mmlu_pro/utils.py' 2026-09-01T00:17:06,244 adding 'lm_eval/tasks/mmlu_prox/README.md' 2026-09-01T00:17:06,248 adding 'lm_eval/tasks/mmlu_prox/lang_libs.py' 2026-09-01T00:17:06,249 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_config_generator.py' 2026-09-01T00:17:06,251 adding 'lm_eval/tasks/mmlu_prox/mmlu_prox_lite_config_generator.py' 2026-09-01T00:17:06,253 adding 'lm_eval/tasks/mmlu_prox/af/_af_lite_template_yaml' 2026-09-01T00:17:06,254 adding 'lm_eval/tasks/mmlu_prox/af/_af_template_yaml' 2026-09-01T00:17:06,255 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_af.yaml' 2026-09-01T00:17:06,257 adding 'lm_eval/tasks/mmlu_prox/af/_mmlu_prox_lite_af.yaml' 2026-09-01T00:17:06,258 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_biology.yaml' 2026-09-01T00:17:06,259 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_business.yaml' 2026-09-01T00:17:06,260 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_chemistry.yaml' 2026-09-01T00:17:06,261 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_computer_science.yaml' 2026-09-01T00:17:06,263 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_economics.yaml' 2026-09-01T00:17:06,264 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_engineering.yaml' 2026-09-01T00:17:06,265 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_health.yaml' 2026-09-01T00:17:06,266 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_history.yaml' 2026-09-01T00:17:06,267 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_law.yaml' 2026-09-01T00:17:06,269 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_math.yaml' 2026-09-01T00:17:06,270 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_other.yaml' 2026-09-01T00:17:06,271 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_philosophy.yaml' 2026-09-01T00:17:06,272 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_physics.yaml' 2026-09-01T00:17:06,273 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_af_psychology.yaml' 2026-09-01T00:17:06,274 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_biology.yaml' 2026-09-01T00:17:06,275 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_business.yaml' 2026-09-01T00:17:06,276 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_chemistry.yaml' 2026-09-01T00:17:06,278 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_computer_science.yaml' 2026-09-01T00:17:06,279 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_economics.yaml' 2026-09-01T00:17:06,280 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_engineering.yaml' 2026-09-01T00:17:06,281 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_health.yaml' 2026-09-01T00:17:06,282 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_history.yaml' 2026-09-01T00:17:06,283 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_law.yaml' 2026-09-01T00:17:06,284 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_math.yaml' 2026-09-01T00:17:06,286 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_other.yaml' 2026-09-01T00:17:06,287 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_philosophy.yaml' 2026-09-01T00:17:06,288 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_physics.yaml' 2026-09-01T00:17:06,289 adding 'lm_eval/tasks/mmlu_prox/af/mmlu_prox_lite_af_psychology.yaml' 2026-09-01T00:17:06,291 adding 'lm_eval/tasks/mmlu_prox/af/utils.py' 2026-09-01T00:17:06,293 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_lite_template_yaml' 2026-09-01T00:17:06,294 adding 'lm_eval/tasks/mmlu_prox/ar/_ar_template_yaml' 2026-09-01T00:17:06,295 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_ar.yaml' 2026-09-01T00:17:06,296 adding 'lm_eval/tasks/mmlu_prox/ar/_mmlu_prox_lite_ar.yaml' 2026-09-01T00:17:06,298 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_biology.yaml' 2026-09-01T00:17:06,299 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_business.yaml' 2026-09-01T00:17:06,300 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_chemistry.yaml' 2026-09-01T00:17:06,301 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_computer_science.yaml' 2026-09-01T00:17:06,303 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_economics.yaml' 2026-09-01T00:17:06,304 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_engineering.yaml' 2026-09-01T00:17:06,305 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_health.yaml' 2026-09-01T00:17:06,306 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_history.yaml' 2026-09-01T00:17:06,307 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_law.yaml' 2026-09-01T00:17:06,309 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_math.yaml' 2026-09-01T00:17:06,310 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_other.yaml' 2026-09-01T00:17:06,311 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_philosophy.yaml' 2026-09-01T00:17:06,312 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_physics.yaml' 2026-09-01T00:17:06,313 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_ar_psychology.yaml' 2026-09-01T00:17:06,315 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_biology.yaml' 2026-09-01T00:17:06,316 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_business.yaml' 2026-09-01T00:17:06,317 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_chemistry.yaml' 2026-09-01T00:17:06,318 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_computer_science.yaml' 2026-09-01T00:17:06,320 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_economics.yaml' 2026-09-01T00:17:06,321 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_engineering.yaml' 2026-09-01T00:17:06,322 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_health.yaml' 2026-09-01T00:17:06,323 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_history.yaml' 2026-09-01T00:17:06,324 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_law.yaml' 2026-09-01T00:17:06,326 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_math.yaml' 2026-09-01T00:17:06,327 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_other.yaml' 2026-09-01T00:17:06,328 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_philosophy.yaml' 2026-09-01T00:17:06,329 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_physics.yaml' 2026-09-01T00:17:06,331 adding 'lm_eval/tasks/mmlu_prox/ar/mmlu_prox_lite_ar_psychology.yaml' 2026-09-01T00:17:06,332 adding 'lm_eval/tasks/mmlu_prox/ar/utils.py' 2026-09-01T00:17:06,334 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_lite_template_yaml' 2026-09-01T00:17:06,335 adding 'lm_eval/tasks/mmlu_prox/bn/_bn_template_yaml' 2026-09-01T00:17:06,336 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_bn.yaml' 2026-09-01T00:17:06,337 adding 'lm_eval/tasks/mmlu_prox/bn/_mmlu_prox_lite_bn.yaml' 2026-09-01T00:17:06,339 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_biology.yaml' 2026-09-01T00:17:06,340 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_business.yaml' 2026-09-01T00:17:06,341 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_chemistry.yaml' 2026-09-01T00:17:06,342 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_computer_science.yaml' 2026-09-01T00:17:06,343 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_economics.yaml' 2026-09-01T00:17:06,345 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_engineering.yaml' 2026-09-01T00:17:06,346 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_health.yaml' 2026-09-01T00:17:06,347 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_history.yaml' 2026-09-01T00:17:06,348 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_law.yaml' 2026-09-01T00:17:06,349 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_math.yaml' 2026-09-01T00:17:06,350 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_other.yaml' 2026-09-01T00:17:06,352 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_philosophy.yaml' 2026-09-01T00:17:06,353 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_physics.yaml' 2026-09-01T00:17:06,354 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_bn_psychology.yaml' 2026-09-01T00:17:06,355 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_biology.yaml' 2026-09-01T00:17:06,357 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_business.yaml' 2026-09-01T00:17:06,358 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_chemistry.yaml' 2026-09-01T00:17:06,359 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_computer_science.yaml' 2026-09-01T00:17:06,360 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_economics.yaml' 2026-09-01T00:17:06,362 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_engineering.yaml' 2026-09-01T00:17:06,363 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_health.yaml' 2026-09-01T00:17:06,364 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_history.yaml' 2026-09-01T00:17:06,365 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_law.yaml' 2026-09-01T00:17:06,366 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_math.yaml' 2026-09-01T00:17:06,368 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_other.yaml' 2026-09-01T00:17:06,369 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_philosophy.yaml' 2026-09-01T00:17:06,370 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_physics.yaml' 2026-09-01T00:17:06,371 adding 'lm_eval/tasks/mmlu_prox/bn/mmlu_prox_lite_bn_psychology.yaml' 2026-09-01T00:17:06,373 adding 'lm_eval/tasks/mmlu_prox/bn/utils.py' 2026-09-01T00:17:06,375 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_lite_template_yaml' 2026-09-01T00:17:06,376 adding 'lm_eval/tasks/mmlu_prox/cs/_cs_template_yaml' 2026-09-01T00:17:06,377 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_cs.yaml' 2026-09-01T00:17:06,379 adding 'lm_eval/tasks/mmlu_prox/cs/_mmlu_prox_lite_cs.yaml' 2026-09-01T00:17:06,380 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_biology.yaml' 2026-09-01T00:17:06,381 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_business.yaml' 2026-09-01T00:17:06,382 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_chemistry.yaml' 2026-09-01T00:17:06,383 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_computer_science.yaml' 2026-09-01T00:17:06,385 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_economics.yaml' 2026-09-01T00:17:06,386 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_engineering.yaml' 2026-09-01T00:17:06,387 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_health.yaml' 2026-09-01T00:17:06,388 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_history.yaml' 2026-09-01T00:17:06,389 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_law.yaml' 2026-09-01T00:17:06,390 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_math.yaml' 2026-09-01T00:17:06,391 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_other.yaml' 2026-09-01T00:17:06,392 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_philosophy.yaml' 2026-09-01T00:17:06,393 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_physics.yaml' 2026-09-01T00:17:06,395 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_cs_psychology.yaml' 2026-09-01T00:17:06,396 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_biology.yaml' 2026-09-01T00:17:06,397 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_business.yaml' 2026-09-01T00:17:06,398 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_chemistry.yaml' 2026-09-01T00:17:06,399 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_computer_science.yaml' 2026-09-01T00:17:06,401 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_economics.yaml' 2026-09-01T00:17:06,402 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_engineering.yaml' 2026-09-01T00:17:06,403 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_health.yaml' 2026-09-01T00:17:06,404 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_history.yaml' 2026-09-01T00:17:06,406 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_law.yaml' 2026-09-01T00:17:06,407 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_math.yaml' 2026-09-01T00:17:06,408 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_other.yaml' 2026-09-01T00:17:06,409 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_philosophy.yaml' 2026-09-01T00:17:06,410 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_physics.yaml' 2026-09-01T00:17:06,412 adding 'lm_eval/tasks/mmlu_prox/cs/mmlu_prox_lite_cs_psychology.yaml' 2026-09-01T00:17:06,413 adding 'lm_eval/tasks/mmlu_prox/cs/utils.py' 2026-09-01T00:17:06,416 adding 'lm_eval/tasks/mmlu_prox/de/_de_lite_template_yaml' 2026-09-01T00:17:06,417 adding 'lm_eval/tasks/mmlu_prox/de/_de_template_yaml' 2026-09-01T00:17:06,418 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_de.yaml' 2026-09-01T00:17:06,419 adding 'lm_eval/tasks/mmlu_prox/de/_mmlu_prox_lite_de.yaml' 2026-09-01T00:17:06,420 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_biology.yaml' 2026-09-01T00:17:06,422 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_business.yaml' 2026-09-01T00:17:06,423 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_chemistry.yaml' 2026-09-01T00:17:06,424 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_computer_science.yaml' 2026-09-01T00:17:06,425 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_economics.yaml' 2026-09-01T00:17:06,426 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_engineering.yaml' 2026-09-01T00:17:06,428 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_health.yaml' 2026-09-01T00:17:06,429 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_history.yaml' 2026-09-01T00:17:06,430 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_law.yaml' 2026-09-01T00:17:06,431 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_math.yaml' 2026-09-01T00:17:06,432 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_other.yaml' 2026-09-01T00:17:06,434 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_philosophy.yaml' 2026-09-01T00:17:06,435 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_physics.yaml' 2026-09-01T00:17:06,436 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_de_psychology.yaml' 2026-09-01T00:17:06,437 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_biology.yaml' 2026-09-01T00:17:06,438 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_business.yaml' 2026-09-01T00:17:06,440 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_chemistry.yaml' 2026-09-01T00:17:06,441 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_computer_science.yaml' 2026-09-01T00:17:06,442 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_economics.yaml' 2026-09-01T00:17:06,443 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_engineering.yaml' 2026-09-01T00:17:06,444 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_health.yaml' 2026-09-01T00:17:06,445 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_history.yaml' 2026-09-01T00:17:06,446 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_law.yaml' 2026-09-01T00:17:06,448 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_math.yaml' 2026-09-01T00:17:06,449 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_other.yaml' 2026-09-01T00:17:06,450 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_philosophy.yaml' 2026-09-01T00:17:06,451 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_physics.yaml' 2026-09-01T00:17:06,452 adding 'lm_eval/tasks/mmlu_prox/de/mmlu_prox_lite_de_psychology.yaml' 2026-09-01T00:17:06,454 adding 'lm_eval/tasks/mmlu_prox/de/utils.py' 2026-09-01T00:17:06,456 adding 'lm_eval/tasks/mmlu_prox/en/_en_lite_template_yaml' 2026-09-01T00:17:06,458 adding 'lm_eval/tasks/mmlu_prox/en/_en_template_yaml' 2026-09-01T00:17:06,459 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_en.yaml' 2026-09-01T00:17:06,460 adding 'lm_eval/tasks/mmlu_prox/en/_mmlu_prox_lite_en.yaml' 2026-09-01T00:17:06,461 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_biology.yaml' 2026-09-01T00:17:06,462 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_business.yaml' 2026-09-01T00:17:06,463 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_chemistry.yaml' 2026-09-01T00:17:06,464 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_computer_science.yaml' 2026-09-01T00:17:06,466 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_economics.yaml' 2026-09-01T00:17:06,467 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_engineering.yaml' 2026-09-01T00:17:06,468 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_health.yaml' 2026-09-01T00:17:06,469 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_history.yaml' 2026-09-01T00:17:06,470 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_law.yaml' 2026-09-01T00:17:06,471 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_math.yaml' 2026-09-01T00:17:06,473 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_other.yaml' 2026-09-01T00:17:06,474 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_philosophy.yaml' 2026-09-01T00:17:06,475 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_physics.yaml' 2026-09-01T00:17:06,476 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_en_psychology.yaml' 2026-09-01T00:17:06,477 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_biology.yaml' 2026-09-01T00:17:06,479 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_business.yaml' 2026-09-01T00:17:06,480 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_chemistry.yaml' 2026-09-01T00:17:06,481 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_computer_science.yaml' 2026-09-01T00:17:06,482 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_economics.yaml' 2026-09-01T00:17:06,483 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_engineering.yaml' 2026-09-01T00:17:06,485 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_health.yaml' 2026-09-01T00:17:06,486 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_history.yaml' 2026-09-01T00:17:06,487 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_law.yaml' 2026-09-01T00:17:06,488 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_math.yaml' 2026-09-01T00:17:06,490 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_other.yaml' 2026-09-01T00:17:06,491 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_philosophy.yaml' 2026-09-01T00:17:06,493 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_physics.yaml' 2026-09-01T00:17:06,494 adding 'lm_eval/tasks/mmlu_prox/en/mmlu_prox_lite_en_psychology.yaml' 2026-09-01T00:17:06,495 adding 'lm_eval/tasks/mmlu_prox/en/utils.py' 2026-09-01T00:17:06,498 adding 'lm_eval/tasks/mmlu_prox/es/_es_lite_template_yaml' 2026-09-01T00:17:06,499 adding 'lm_eval/tasks/mmlu_prox/es/_es_template_yaml' 2026-09-01T00:17:06,501 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_es.yaml' 2026-09-01T00:17:06,502 adding 'lm_eval/tasks/mmlu_prox/es/_mmlu_prox_lite_es.yaml' 2026-09-01T00:17:06,503 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_biology.yaml' 2026-09-01T00:17:06,504 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_business.yaml' 2026-09-01T00:17:06,505 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_chemistry.yaml' 2026-09-01T00:17:06,507 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_computer_science.yaml' 2026-09-01T00:17:06,508 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_economics.yaml' 2026-09-01T00:17:06,509 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_engineering.yaml' 2026-09-01T00:17:06,510 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_health.yaml' 2026-09-01T00:17:06,511 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_history.yaml' 2026-09-01T00:17:06,512 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_law.yaml' 2026-09-01T00:17:06,513 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_math.yaml' 2026-09-01T00:17:06,515 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_other.yaml' 2026-09-01T00:17:06,516 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_philosophy.yaml' 2026-09-01T00:17:06,517 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_physics.yaml' 2026-09-01T00:17:06,518 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_es_psychology.yaml' 2026-09-01T00:17:06,519 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_biology.yaml' 2026-09-01T00:17:06,520 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_business.yaml' 2026-09-01T00:17:06,521 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_chemistry.yaml' 2026-09-01T00:17:06,522 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_computer_science.yaml' 2026-09-01T00:17:06,523 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_economics.yaml' 2026-09-01T00:17:06,524 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_engineering.yaml' 2026-09-01T00:17:06,526 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_health.yaml' 2026-09-01T00:17:06,527 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_history.yaml' 2026-09-01T00:17:06,528 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_law.yaml' 2026-09-01T00:17:06,529 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_math.yaml' 2026-09-01T00:17:06,530 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_other.yaml' 2026-09-01T00:17:06,532 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_philosophy.yaml' 2026-09-01T00:17:06,533 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_physics.yaml' 2026-09-01T00:17:06,534 adding 'lm_eval/tasks/mmlu_prox/es/mmlu_prox_lite_es_psychology.yaml' 2026-09-01T00:17:06,535 adding 'lm_eval/tasks/mmlu_prox/es/utils.py' 2026-09-01T00:17:06,538 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_lite_template_yaml' 2026-09-01T00:17:06,539 adding 'lm_eval/tasks/mmlu_prox/fr/_fr_template_yaml' 2026-09-01T00:17:06,540 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_fr.yaml' 2026-09-01T00:17:06,541 adding 'lm_eval/tasks/mmlu_prox/fr/_mmlu_prox_lite_fr.yaml' 2026-09-01T00:17:06,542 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_biology.yaml' 2026-09-01T00:17:06,544 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_business.yaml' 2026-09-01T00:17:06,545 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_chemistry.yaml' 2026-09-01T00:17:06,546 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_computer_science.yaml' 2026-09-01T00:17:06,547 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_economics.yaml' 2026-09-01T00:17:06,549 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_engineering.yaml' 2026-09-01T00:17:06,550 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_health.yaml' 2026-09-01T00:17:06,551 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_history.yaml' 2026-09-01T00:17:06,552 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_law.yaml' 2026-09-01T00:17:06,553 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_math.yaml' 2026-09-01T00:17:06,554 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_other.yaml' 2026-09-01T00:17:06,555 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_philosophy.yaml' 2026-09-01T00:17:06,557 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_physics.yaml' 2026-09-01T00:17:06,558 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_fr_psychology.yaml' 2026-09-01T00:17:06,559 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_biology.yaml' 2026-09-01T00:17:06,560 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_business.yaml' 2026-09-01T00:17:06,561 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_chemistry.yaml' 2026-09-01T00:17:06,562 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_computer_science.yaml' 2026-09-01T00:17:06,563 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_economics.yaml' 2026-09-01T00:17:06,564 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_engineering.yaml' 2026-09-01T00:17:06,565 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_health.yaml' 2026-09-01T00:17:06,567 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_history.yaml' 2026-09-01T00:17:06,568 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_law.yaml' 2026-09-01T00:17:06,569 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_math.yaml' 2026-09-01T00:17:06,570 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_other.yaml' 2026-09-01T00:17:06,571 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_philosophy.yaml' 2026-09-01T00:17:06,572 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_physics.yaml' 2026-09-01T00:17:06,574 adding 'lm_eval/tasks/mmlu_prox/fr/mmlu_prox_lite_fr_psychology.yaml' 2026-09-01T00:17:06,575 adding 'lm_eval/tasks/mmlu_prox/fr/utils.py' 2026-09-01T00:17:06,577 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_lite_template_yaml' 2026-09-01T00:17:06,579 adding 'lm_eval/tasks/mmlu_prox/hi/_hi_template_yaml' 2026-09-01T00:17:06,580 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_hi.yaml' 2026-09-01T00:17:06,581 adding 'lm_eval/tasks/mmlu_prox/hi/_mmlu_prox_lite_hi.yaml' 2026-09-01T00:17:06,582 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_biology.yaml' 2026-09-01T00:17:06,584 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_business.yaml' 2026-09-01T00:17:06,585 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_chemistry.yaml' 2026-09-01T00:17:06,586 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_computer_science.yaml' 2026-09-01T00:17:06,588 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_economics.yaml' 2026-09-01T00:17:06,589 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_engineering.yaml' 2026-09-01T00:17:06,590 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_health.yaml' 2026-09-01T00:17:06,591 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_history.yaml' 2026-09-01T00:17:06,593 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_law.yaml' 2026-09-01T00:17:06,594 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_math.yaml' 2026-09-01T00:17:06,595 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_other.yaml' 2026-09-01T00:17:06,596 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_philosophy.yaml' 2026-09-01T00:17:06,598 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_physics.yaml' 2026-09-01T00:17:06,599 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_hi_psychology.yaml' 2026-09-01T00:17:06,600 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_biology.yaml' 2026-09-01T00:17:06,601 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_business.yaml' 2026-09-01T00:17:06,602 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_chemistry.yaml' 2026-09-01T00:17:06,604 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_computer_science.yaml' 2026-09-01T00:17:06,605 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_economics.yaml' 2026-09-01T00:17:06,606 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_engineering.yaml' 2026-09-01T00:17:06,607 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_health.yaml' 2026-09-01T00:17:06,609 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_history.yaml' 2026-09-01T00:17:06,610 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_law.yaml' 2026-09-01T00:17:06,611 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_math.yaml' 2026-09-01T00:17:06,612 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_other.yaml' 2026-09-01T00:17:06,613 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_philosophy.yaml' 2026-09-01T00:17:06,615 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_physics.yaml' 2026-09-01T00:17:06,616 adding 'lm_eval/tasks/mmlu_prox/hi/mmlu_prox_lite_hi_psychology.yaml' 2026-09-01T00:17:06,617 adding 'lm_eval/tasks/mmlu_prox/hi/utils.py' 2026-09-01T00:17:06,619 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_lite_template_yaml' 2026-09-01T00:17:06,620 adding 'lm_eval/tasks/mmlu_prox/hu/_hu_template_yaml' 2026-09-01T00:17:06,622 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_hu.yaml' 2026-09-01T00:17:06,623 adding 'lm_eval/tasks/mmlu_prox/hu/_mmlu_prox_lite_hu.yaml' 2026-09-01T00:17:06,624 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_biology.yaml' 2026-09-01T00:17:06,625 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_business.yaml' 2026-09-01T00:17:06,626 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_chemistry.yaml' 2026-09-01T00:17:06,628 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_computer_science.yaml' 2026-09-01T00:17:06,629 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_economics.yaml' 2026-09-01T00:17:06,630 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_engineering.yaml' 2026-09-01T00:17:06,631 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_health.yaml' 2026-09-01T00:17:06,632 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_history.yaml' 2026-09-01T00:17:06,634 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_law.yaml' 2026-09-01T00:17:06,635 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_math.yaml' 2026-09-01T00:17:06,636 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_other.yaml' 2026-09-01T00:17:06,637 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_philosophy.yaml' 2026-09-01T00:17:06,638 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_physics.yaml' 2026-09-01T00:17:06,640 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_hu_psychology.yaml' 2026-09-01T00:17:06,641 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_biology.yaml' 2026-09-01T00:17:06,642 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_business.yaml' 2026-09-01T00:17:06,643 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_chemistry.yaml' 2026-09-01T00:17:06,645 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_computer_science.yaml' 2026-09-01T00:17:06,646 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_economics.yaml' 2026-09-01T00:17:06,647 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_engineering.yaml' 2026-09-01T00:17:06,648 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_health.yaml' 2026-09-01T00:17:06,649 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_history.yaml' 2026-09-01T00:17:06,651 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_law.yaml' 2026-09-01T00:17:06,652 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_math.yaml' 2026-09-01T00:17:06,653 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_other.yaml' 2026-09-01T00:17:06,654 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_philosophy.yaml' 2026-09-01T00:17:06,656 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_physics.yaml' 2026-09-01T00:17:06,657 adding 'lm_eval/tasks/mmlu_prox/hu/mmlu_prox_lite_hu_psychology.yaml' 2026-09-01T00:17:06,658 adding 'lm_eval/tasks/mmlu_prox/hu/utils.py' 2026-09-01T00:17:06,660 adding 'lm_eval/tasks/mmlu_prox/id/_id_lite_template_yaml' 2026-09-01T00:17:06,662 adding 'lm_eval/tasks/mmlu_prox/id/_id_template_yaml' 2026-09-01T00:17:06,663 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_id.yaml' 2026-09-01T00:17:06,664 adding 'lm_eval/tasks/mmlu_prox/id/_mmlu_prox_lite_id.yaml' 2026-09-01T00:17:06,665 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_biology.yaml' 2026-09-01T00:17:06,666 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_business.yaml' 2026-09-01T00:17:06,668 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_chemistry.yaml' 2026-09-01T00:17:06,669 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_computer_science.yaml' 2026-09-01T00:17:06,670 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_economics.yaml' 2026-09-01T00:17:06,671 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_engineering.yaml' 2026-09-01T00:17:06,672 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_health.yaml' 2026-09-01T00:17:06,673 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_history.yaml' 2026-09-01T00:17:06,674 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_law.yaml' 2026-09-01T00:17:06,675 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_math.yaml' 2026-09-01T00:17:06,676 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_other.yaml' 2026-09-01T00:17:06,677 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_philosophy.yaml' 2026-09-01T00:17:06,679 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_physics.yaml' 2026-09-01T00:17:06,680 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_id_psychology.yaml' 2026-09-01T00:17:06,681 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_biology.yaml' 2026-09-01T00:17:06,682 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_business.yaml' 2026-09-01T00:17:06,683 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_chemistry.yaml' 2026-09-01T00:17:06,684 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_computer_science.yaml' 2026-09-01T00:17:06,685 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_economics.yaml' 2026-09-01T00:17:06,686 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_engineering.yaml' 2026-09-01T00:17:06,688 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_health.yaml' 2026-09-01T00:17:06,689 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_history.yaml' 2026-09-01T00:17:06,690 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_law.yaml' 2026-09-01T00:17:06,691 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_math.yaml' 2026-09-01T00:17:06,692 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_other.yaml' 2026-09-01T00:17:06,694 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_philosophy.yaml' 2026-09-01T00:17:06,695 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_physics.yaml' 2026-09-01T00:17:06,696 adding 'lm_eval/tasks/mmlu_prox/id/mmlu_prox_lite_id_psychology.yaml' 2026-09-01T00:17:06,697 adding 'lm_eval/tasks/mmlu_prox/id/utils.py' 2026-09-01T00:17:06,699 adding 'lm_eval/tasks/mmlu_prox/it/_it_lite_template_yaml' 2026-09-01T00:17:06,701 adding 'lm_eval/tasks/mmlu_prox/it/_it_template_yaml' 2026-09-01T00:17:06,702 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_it.yaml' 2026-09-01T00:17:06,703 adding 'lm_eval/tasks/mmlu_prox/it/_mmlu_prox_lite_it.yaml' 2026-09-01T00:17:06,704 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_biology.yaml' 2026-09-01T00:17:06,706 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_business.yaml' 2026-09-01T00:17:06,707 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_chemistry.yaml' 2026-09-01T00:17:06,708 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_computer_science.yaml' 2026-09-01T00:17:06,709 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_economics.yaml' 2026-09-01T00:17:06,711 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_engineering.yaml' 2026-09-01T00:17:06,712 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_health.yaml' 2026-09-01T00:17:06,713 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_history.yaml' 2026-09-01T00:17:06,714 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_law.yaml' 2026-09-01T00:17:06,715 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_math.yaml' 2026-09-01T00:17:06,717 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_other.yaml' 2026-09-01T00:17:06,718 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_philosophy.yaml' 2026-09-01T00:17:06,719 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_physics.yaml' 2026-09-01T00:17:06,720 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_it_psychology.yaml' 2026-09-01T00:17:06,722 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_biology.yaml' 2026-09-01T00:17:06,723 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_business.yaml' 2026-09-01T00:17:06,724 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_chemistry.yaml' 2026-09-01T00:17:06,725 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_computer_science.yaml' 2026-09-01T00:17:06,726 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_economics.yaml' 2026-09-01T00:17:06,727 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_engineering.yaml' 2026-09-01T00:17:06,728 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_health.yaml' 2026-09-01T00:17:06,729 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_history.yaml' 2026-09-01T00:17:06,730 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_law.yaml' 2026-09-01T00:17:06,731 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_math.yaml' 2026-09-01T00:17:06,732 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_other.yaml' 2026-09-01T00:17:06,734 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_philosophy.yaml' 2026-09-01T00:17:06,735 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_physics.yaml' 2026-09-01T00:17:06,736 adding 'lm_eval/tasks/mmlu_prox/it/mmlu_prox_lite_it_psychology.yaml' 2026-09-01T00:17:06,737 adding 'lm_eval/tasks/mmlu_prox/it/utils.py' 2026-09-01T00:17:06,739 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_lite_template_yaml' 2026-09-01T00:17:06,741 adding 'lm_eval/tasks/mmlu_prox/ja/_ja_template_yaml' 2026-09-01T00:17:06,742 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_ja.yaml' 2026-09-01T00:17:06,743 adding 'lm_eval/tasks/mmlu_prox/ja/_mmlu_prox_lite_ja.yaml' 2026-09-01T00:17:06,744 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_biology.yaml' 2026-09-01T00:17:06,745 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_business.yaml' 2026-09-01T00:17:06,746 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_chemistry.yaml' 2026-09-01T00:17:06,748 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_computer_science.yaml' 2026-09-01T00:17:06,749 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_economics.yaml' 2026-09-01T00:17:06,750 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_engineering.yaml' 2026-09-01T00:17:06,751 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_health.yaml' 2026-09-01T00:17:06,752 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_history.yaml' 2026-09-01T00:17:06,754 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_law.yaml' 2026-09-01T00:17:06,755 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_math.yaml' 2026-09-01T00:17:06,756 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_other.yaml' 2026-09-01T00:17:06,757 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_philosophy.yaml' 2026-09-01T00:17:06,758 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_physics.yaml' 2026-09-01T00:17:06,760 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_ja_psychology.yaml' 2026-09-01T00:17:06,761 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_biology.yaml' 2026-09-01T00:17:06,762 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_business.yaml' 2026-09-01T00:17:06,763 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_chemistry.yaml' 2026-09-01T00:17:06,765 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_computer_science.yaml' 2026-09-01T00:17:06,766 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_economics.yaml' 2026-09-01T00:17:06,767 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_engineering.yaml' 2026-09-01T00:17:06,768 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_health.yaml' 2026-09-01T00:17:06,770 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_history.yaml' 2026-09-01T00:17:06,771 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_law.yaml' 2026-09-01T00:17:06,772 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_math.yaml' 2026-09-01T00:17:06,773 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_other.yaml' 2026-09-01T00:17:06,774 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_philosophy.yaml' 2026-09-01T00:17:06,776 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_physics.yaml' 2026-09-01T00:17:06,777 adding 'lm_eval/tasks/mmlu_prox/ja/mmlu_prox_lite_ja_psychology.yaml' 2026-09-01T00:17:06,778 adding 'lm_eval/tasks/mmlu_prox/ja/utils.py' 2026-09-01T00:17:06,780 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_lite_template_yaml' 2026-09-01T00:17:06,782 adding 'lm_eval/tasks/mmlu_prox/ko/_ko_template_yaml' 2026-09-01T00:17:06,783 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_ko.yaml' 2026-09-01T00:17:06,784 adding 'lm_eval/tasks/mmlu_prox/ko/_mmlu_prox_lite_ko.yaml' 2026-09-01T00:17:06,785 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_biology.yaml' 2026-09-01T00:17:06,786 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_business.yaml' 2026-09-01T00:17:06,787 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_chemistry.yaml' 2026-09-01T00:17:06,788 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_computer_science.yaml' 2026-09-01T00:17:06,790 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_economics.yaml' 2026-09-01T00:17:06,791 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_engineering.yaml' 2026-09-01T00:17:06,792 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_health.yaml' 2026-09-01T00:17:06,793 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_history.yaml' 2026-09-01T00:17:06,794 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_law.yaml' 2026-09-01T00:17:06,795 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_math.yaml' 2026-09-01T00:17:06,797 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_other.yaml' 2026-09-01T00:17:06,798 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_philosophy.yaml' 2026-09-01T00:17:06,799 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_physics.yaml' 2026-09-01T00:17:06,800 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_ko_psychology.yaml' 2026-09-01T00:17:06,801 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_biology.yaml' 2026-09-01T00:17:06,802 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_business.yaml' 2026-09-01T00:17:06,803 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_chemistry.yaml' 2026-09-01T00:17:06,805 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_computer_science.yaml' 2026-09-01T00:17:06,806 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_economics.yaml' 2026-09-01T00:17:06,807 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_engineering.yaml' 2026-09-01T00:17:06,808 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_health.yaml' 2026-09-01T00:17:06,809 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_history.yaml' 2026-09-01T00:17:06,811 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_law.yaml' 2026-09-01T00:17:06,812 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_math.yaml' 2026-09-01T00:17:06,813 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_other.yaml' 2026-09-01T00:17:06,814 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_philosophy.yaml' 2026-09-01T00:17:06,815 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_physics.yaml' 2026-09-01T00:17:06,816 adding 'lm_eval/tasks/mmlu_prox/ko/mmlu_prox_lite_ko_psychology.yaml' 2026-09-01T00:17:06,818 adding 'lm_eval/tasks/mmlu_prox/ko/utils.py' 2026-09-01T00:17:06,820 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_lite_mr.yaml' 2026-09-01T00:17:06,821 adding 'lm_eval/tasks/mmlu_prox/mr/_mmlu_prox_mr.yaml' 2026-09-01T00:17:06,822 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_lite_template_yaml' 2026-09-01T00:17:06,824 adding 'lm_eval/tasks/mmlu_prox/mr/_mr_template_yaml' 2026-09-01T00:17:06,825 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_biology.yaml' 2026-09-01T00:17:06,826 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_business.yaml' 2026-09-01T00:17:06,827 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_chemistry.yaml' 2026-09-01T00:17:06,829 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_computer_science.yaml' 2026-09-01T00:17:06,830 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_economics.yaml' 2026-09-01T00:17:06,831 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_engineering.yaml' 2026-09-01T00:17:06,832 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_health.yaml' 2026-09-01T00:17:06,833 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_history.yaml' 2026-09-01T00:17:06,835 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_law.yaml' 2026-09-01T00:17:06,836 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_math.yaml' 2026-09-01T00:17:06,837 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_other.yaml' 2026-09-01T00:17:06,838 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_philosophy.yaml' 2026-09-01T00:17:06,839 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_physics.yaml' 2026-09-01T00:17:06,840 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_lite_mr_psychology.yaml' 2026-09-01T00:17:06,841 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_biology.yaml' 2026-09-01T00:17:06,843 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_business.yaml' 2026-09-01T00:17:06,844 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_chemistry.yaml' 2026-09-01T00:17:06,845 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_computer_science.yaml' 2026-09-01T00:17:06,846 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_economics.yaml' 2026-09-01T00:17:06,847 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_engineering.yaml' 2026-09-01T00:17:06,849 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_health.yaml' 2026-09-01T00:17:06,850 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_history.yaml' 2026-09-01T00:17:06,851 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_law.yaml' 2026-09-01T00:17:06,852 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_math.yaml' 2026-09-01T00:17:06,853 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_other.yaml' 2026-09-01T00:17:06,854 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_philosophy.yaml' 2026-09-01T00:17:06,856 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_physics.yaml' 2026-09-01T00:17:06,857 adding 'lm_eval/tasks/mmlu_prox/mr/mmlu_prox_mr_psychology.yaml' 2026-09-01T00:17:06,858 adding 'lm_eval/tasks/mmlu_prox/mr/utils.py' 2026-09-01T00:17:06,860 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_lite_ne.yaml' 2026-09-01T00:17:06,862 adding 'lm_eval/tasks/mmlu_prox/ne/_mmlu_prox_ne.yaml' 2026-09-01T00:17:06,863 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_lite_template_yaml' 2026-09-01T00:17:06,864 adding 'lm_eval/tasks/mmlu_prox/ne/_ne_template_yaml' 2026-09-01T00:17:06,866 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_biology.yaml' 2026-09-01T00:17:06,867 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_business.yaml' 2026-09-01T00:17:06,868 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_chemistry.yaml' 2026-09-01T00:17:06,869 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_computer_science.yaml' 2026-09-01T00:17:06,871 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_economics.yaml' 2026-09-01T00:17:06,872 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_engineering.yaml' 2026-09-01T00:17:06,873 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_health.yaml' 2026-09-01T00:17:06,874 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_history.yaml' 2026-09-01T00:17:06,876 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_law.yaml' 2026-09-01T00:17:06,877 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_math.yaml' 2026-09-01T00:17:06,878 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_other.yaml' 2026-09-01T00:17:06,879 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_philosophy.yaml' 2026-09-01T00:17:06,880 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_physics.yaml' 2026-09-01T00:17:06,882 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_lite_ne_psychology.yaml' 2026-09-01T00:17:06,883 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_biology.yaml' 2026-09-01T00:17:06,884 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_business.yaml' 2026-09-01T00:17:06,885 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_chemistry.yaml' 2026-09-01T00:17:06,887 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_computer_science.yaml' 2026-09-01T00:17:06,888 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_economics.yaml' 2026-09-01T00:17:06,889 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_engineering.yaml' 2026-09-01T00:17:06,890 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_health.yaml' 2026-09-01T00:17:06,891 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_history.yaml' 2026-09-01T00:17:06,892 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_law.yaml' 2026-09-01T00:17:06,893 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_math.yaml' 2026-09-01T00:17:06,894 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_other.yaml' 2026-09-01T00:17:06,895 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_philosophy.yaml' 2026-09-01T00:17:06,897 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_physics.yaml' 2026-09-01T00:17:06,898 adding 'lm_eval/tasks/mmlu_prox/ne/mmlu_prox_ne_psychology.yaml' 2026-09-01T00:17:06,899 adding 'lm_eval/tasks/mmlu_prox/ne/utils.py' 2026-09-01T00:17:06,901 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_lite_pt.yaml' 2026-09-01T00:17:06,902 adding 'lm_eval/tasks/mmlu_prox/pt/_mmlu_prox_pt.yaml' 2026-09-01T00:17:06,904 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_lite_template_yaml' 2026-09-01T00:17:06,905 adding 'lm_eval/tasks/mmlu_prox/pt/_pt_template_yaml' 2026-09-01T00:17:06,906 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_biology.yaml' 2026-09-01T00:17:06,908 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_business.yaml' 2026-09-01T00:17:06,909 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_chemistry.yaml' 2026-09-01T00:17:06,910 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_computer_science.yaml' 2026-09-01T00:17:06,911 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_economics.yaml' 2026-09-01T00:17:06,912 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_engineering.yaml' 2026-09-01T00:17:06,913 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_health.yaml' 2026-09-01T00:17:06,914 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_history.yaml' 2026-09-01T00:17:06,915 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_law.yaml' 2026-09-01T00:17:06,917 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_math.yaml' 2026-09-01T00:17:06,918 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_other.yaml' 2026-09-01T00:17:06,919 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_philosophy.yaml' 2026-09-01T00:17:06,920 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_physics.yaml' 2026-09-01T00:17:06,921 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_lite_pt_psychology.yaml' 2026-09-01T00:17:06,922 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_biology.yaml' 2026-09-01T00:17:06,923 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_business.yaml' 2026-09-01T00:17:06,925 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_chemistry.yaml' 2026-09-01T00:17:06,926 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_computer_science.yaml' 2026-09-01T00:17:06,927 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_economics.yaml' 2026-09-01T00:17:06,928 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_engineering.yaml' 2026-09-01T00:17:06,929 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_health.yaml' 2026-09-01T00:17:06,931 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_history.yaml' 2026-09-01T00:17:06,932 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_law.yaml' 2026-09-01T00:17:06,933 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_math.yaml' 2026-09-01T00:17:06,934 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_other.yaml' 2026-09-01T00:17:06,935 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_philosophy.yaml' 2026-09-01T00:17:06,937 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_physics.yaml' 2026-09-01T00:17:06,938 adding 'lm_eval/tasks/mmlu_prox/pt/mmlu_prox_pt_psychology.yaml' 2026-09-01T00:17:06,939 adding 'lm_eval/tasks/mmlu_prox/pt/utils.py' 2026-09-01T00:17:06,941 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_lite_ru.yaml' 2026-09-01T00:17:06,942 adding 'lm_eval/tasks/mmlu_prox/ru/_mmlu_prox_ru.yaml' 2026-09-01T00:17:06,944 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_lite_template_yaml' 2026-09-01T00:17:06,945 adding 'lm_eval/tasks/mmlu_prox/ru/_ru_template_yaml' 2026-09-01T00:17:06,946 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_biology.yaml' 2026-09-01T00:17:06,947 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_business.yaml' 2026-09-01T00:17:06,948 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_chemistry.yaml' 2026-09-01T00:17:06,949 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_computer_science.yaml' 2026-09-01T00:17:06,951 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_economics.yaml' 2026-09-01T00:17:06,952 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_engineering.yaml' 2026-09-01T00:17:06,953 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_health.yaml' 2026-09-01T00:17:06,954 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_history.yaml' 2026-09-01T00:17:06,955 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_law.yaml' 2026-09-01T00:17:06,956 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_math.yaml' 2026-09-01T00:17:06,958 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_other.yaml' 2026-09-01T00:17:06,959 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_philosophy.yaml' 2026-09-01T00:17:06,960 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_physics.yaml' 2026-09-01T00:17:06,961 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_lite_ru_psychology.yaml' 2026-09-01T00:17:06,962 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_biology.yaml' 2026-09-01T00:17:06,963 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_business.yaml' 2026-09-01T00:17:06,965 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_chemistry.yaml' 2026-09-01T00:17:06,966 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_computer_science.yaml' 2026-09-01T00:17:06,967 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_economics.yaml' 2026-09-01T00:17:06,968 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_engineering.yaml' 2026-09-01T00:17:06,970 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_health.yaml' 2026-09-01T00:17:06,971 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_history.yaml' 2026-09-01T00:17:06,972 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_law.yaml' 2026-09-01T00:17:06,973 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_math.yaml' 2026-09-01T00:17:06,974 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_other.yaml' 2026-09-01T00:17:06,976 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_philosophy.yaml' 2026-09-01T00:17:06,977 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_physics.yaml' 2026-09-01T00:17:06,978 adding 'lm_eval/tasks/mmlu_prox/ru/mmlu_prox_ru_psychology.yaml' 2026-09-01T00:17:06,980 adding 'lm_eval/tasks/mmlu_prox/ru/utils.py' 2026-09-01T00:17:06,982 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_lite_sr.yaml' 2026-09-01T00:17:06,983 adding 'lm_eval/tasks/mmlu_prox/sr/_mmlu_prox_sr.yaml' 2026-09-01T00:17:06,984 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_lite_template_yaml' 2026-09-01T00:17:06,985 adding 'lm_eval/tasks/mmlu_prox/sr/_sr_template_yaml' 2026-09-01T00:17:06,987 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_biology.yaml' 2026-09-01T00:17:06,988 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_business.yaml' 2026-09-01T00:17:06,989 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_chemistry.yaml' 2026-09-01T00:17:06,990 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_computer_science.yaml' 2026-09-01T00:17:06,992 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_economics.yaml' 2026-09-01T00:17:06,993 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_engineering.yaml' 2026-09-01T00:17:06,994 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_health.yaml' 2026-09-01T00:17:06,995 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_history.yaml' 2026-09-01T00:17:06,997 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_law.yaml' 2026-09-01T00:17:06,998 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_math.yaml' 2026-09-01T00:17:06,999 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_other.yaml' 2026-09-01T00:17:07,000 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_philosophy.yaml' 2026-09-01T00:17:07,001 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_physics.yaml' 2026-09-01T00:17:07,002 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_lite_sr_psychology.yaml' 2026-09-01T00:17:07,004 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_biology.yaml' 2026-09-01T00:17:07,005 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_business.yaml' 2026-09-01T00:17:07,006 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_chemistry.yaml' 2026-09-01T00:17:07,007 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_computer_science.yaml' 2026-09-01T00:17:07,008 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_economics.yaml' 2026-09-01T00:17:07,009 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_engineering.yaml' 2026-09-01T00:17:07,010 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_health.yaml' 2026-09-01T00:17:07,011 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_history.yaml' 2026-09-01T00:17:07,012 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_law.yaml' 2026-09-01T00:17:07,013 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_math.yaml' 2026-09-01T00:17:07,015 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_other.yaml' 2026-09-01T00:17:07,016 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_philosophy.yaml' 2026-09-01T00:17:07,017 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_physics.yaml' 2026-09-01T00:17:07,018 adding 'lm_eval/tasks/mmlu_prox/sr/mmlu_prox_sr_psychology.yaml' 2026-09-01T00:17:07,019 adding 'lm_eval/tasks/mmlu_prox/sr/utils.py' 2026-09-01T00:17:07,021 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_lite_sw.yaml' 2026-09-01T00:17:07,022 adding 'lm_eval/tasks/mmlu_prox/sw/_mmlu_prox_sw.yaml' 2026-09-01T00:17:07,024 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_lite_template_yaml' 2026-09-01T00:17:07,025 adding 'lm_eval/tasks/mmlu_prox/sw/_sw_template_yaml' 2026-09-01T00:17:07,026 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_biology.yaml' 2026-09-01T00:17:07,027 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_business.yaml' 2026-09-01T00:17:07,028 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_chemistry.yaml' 2026-09-01T00:17:07,030 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_computer_science.yaml' 2026-09-01T00:17:07,031 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_economics.yaml' 2026-09-01T00:17:07,032 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_engineering.yaml' 2026-09-01T00:17:07,033 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_health.yaml' 2026-09-01T00:17:07,034 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_history.yaml' 2026-09-01T00:17:07,036 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_law.yaml' 2026-09-01T00:17:07,037 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_math.yaml' 2026-09-01T00:17:07,038 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_other.yaml' 2026-09-01T00:17:07,039 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_philosophy.yaml' 2026-09-01T00:17:07,040 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_physics.yaml' 2026-09-01T00:17:07,042 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_lite_sw_psychology.yaml' 2026-09-01T00:17:07,043 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_biology.yaml' 2026-09-01T00:17:07,044 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_business.yaml' 2026-09-01T00:17:07,045 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_chemistry.yaml' 2026-09-01T00:17:07,046 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_computer_science.yaml' 2026-09-01T00:17:07,048 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_economics.yaml' 2026-09-01T00:17:07,049 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_engineering.yaml' 2026-09-01T00:17:07,050 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_health.yaml' 2026-09-01T00:17:07,051 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_history.yaml' 2026-09-01T00:17:07,052 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_law.yaml' 2026-09-01T00:17:07,054 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_math.yaml' 2026-09-01T00:17:07,055 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_other.yaml' 2026-09-01T00:17:07,056 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_philosophy.yaml' 2026-09-01T00:17:07,057 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_physics.yaml' 2026-09-01T00:17:07,058 adding 'lm_eval/tasks/mmlu_prox/sw/mmlu_prox_sw_psychology.yaml' 2026-09-01T00:17:07,059 adding 'lm_eval/tasks/mmlu_prox/sw/utils.py' 2026-09-01T00:17:07,061 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_lite_te.yaml' 2026-09-01T00:17:07,062 adding 'lm_eval/tasks/mmlu_prox/te/_mmlu_prox_te.yaml' 2026-09-01T00:17:07,064 adding 'lm_eval/tasks/mmlu_prox/te/_te_lite_template_yaml' 2026-09-01T00:17:07,065 adding 'lm_eval/tasks/mmlu_prox/te/_te_template_yaml' 2026-09-01T00:17:07,066 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_biology.yaml' 2026-09-01T00:17:07,067 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_business.yaml' 2026-09-01T00:17:07,068 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_chemistry.yaml' 2026-09-01T00:17:07,069 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_computer_science.yaml' 2026-09-01T00:17:07,070 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_economics.yaml' 2026-09-01T00:17:07,072 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_engineering.yaml' 2026-09-01T00:17:07,073 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_health.yaml' 2026-09-01T00:17:07,074 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_history.yaml' 2026-09-01T00:17:07,075 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_law.yaml' 2026-09-01T00:17:07,076 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_math.yaml' 2026-09-01T00:17:07,078 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_other.yaml' 2026-09-01T00:17:07,079 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_philosophy.yaml' 2026-09-01T00:17:07,080 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_physics.yaml' 2026-09-01T00:17:07,081 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_lite_te_psychology.yaml' 2026-09-01T00:17:07,082 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_biology.yaml' 2026-09-01T00:17:07,084 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_business.yaml' 2026-09-01T00:17:07,085 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_chemistry.yaml' 2026-09-01T00:17:07,086 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_computer_science.yaml' 2026-09-01T00:17:07,087 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_economics.yaml' 2026-09-01T00:17:07,089 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_engineering.yaml' 2026-09-01T00:17:07,090 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_health.yaml' 2026-09-01T00:17:07,091 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_history.yaml' 2026-09-01T00:17:07,092 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_law.yaml' 2026-09-01T00:17:07,093 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_math.yaml' 2026-09-01T00:17:07,095 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_other.yaml' 2026-09-01T00:17:07,096 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_philosophy.yaml' 2026-09-01T00:17:07,097 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_physics.yaml' 2026-09-01T00:17:07,098 adding 'lm_eval/tasks/mmlu_prox/te/mmlu_prox_te_psychology.yaml' 2026-09-01T00:17:07,100 adding 'lm_eval/tasks/mmlu_prox/te/utils.py' 2026-09-01T00:17:07,101 adding 'lm_eval/tasks/mmlu_prox/template/_lang_template_yaml' 2026-09-01T00:17:07,103 adding 'lm_eval/tasks/mmlu_prox/template/utils.py' 2026-09-01T00:17:07,105 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_lite_th.yaml' 2026-09-01T00:17:07,106 adding 'lm_eval/tasks/mmlu_prox/th/_mmlu_prox_th.yaml' 2026-09-01T00:17:07,107 adding 'lm_eval/tasks/mmlu_prox/th/_th_lite_template_yaml' 2026-09-01T00:17:07,109 adding 'lm_eval/tasks/mmlu_prox/th/_th_template_yaml' 2026-09-01T00:17:07,110 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_biology.yaml' 2026-09-01T00:17:07,111 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_business.yaml' 2026-09-01T00:17:07,112 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_chemistry.yaml' 2026-09-01T00:17:07,113 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_computer_science.yaml' 2026-09-01T00:17:07,115 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_economics.yaml' 2026-09-01T00:17:07,116 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_engineering.yaml' 2026-09-01T00:17:07,117 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_health.yaml' 2026-09-01T00:17:07,118 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_history.yaml' 2026-09-01T00:17:07,119 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_law.yaml' 2026-09-01T00:17:07,120 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_math.yaml' 2026-09-01T00:17:07,121 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_other.yaml' 2026-09-01T00:17:07,122 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_philosophy.yaml' 2026-09-01T00:17:07,124 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_physics.yaml' 2026-09-01T00:17:07,125 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_lite_th_psychology.yaml' 2026-09-01T00:17:07,126 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_biology.yaml' 2026-09-01T00:17:07,127 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_business.yaml' 2026-09-01T00:17:07,128 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_chemistry.yaml' 2026-09-01T00:17:07,130 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_computer_science.yaml' 2026-09-01T00:17:07,131 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_economics.yaml' 2026-09-01T00:17:07,132 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_engineering.yaml' 2026-09-01T00:17:07,133 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_health.yaml' 2026-09-01T00:17:07,134 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_history.yaml' 2026-09-01T00:17:07,135 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_law.yaml' 2026-09-01T00:17:07,137 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_math.yaml' 2026-09-01T00:17:07,138 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_other.yaml' 2026-09-01T00:17:07,139 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_philosophy.yaml' 2026-09-01T00:17:07,140 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_physics.yaml' 2026-09-01T00:17:07,141 adding 'lm_eval/tasks/mmlu_prox/th/mmlu_prox_th_psychology.yaml' 2026-09-01T00:17:07,143 adding 'lm_eval/tasks/mmlu_prox/th/utils.py' 2026-09-01T00:17:07,145 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_lite_uk.yaml' 2026-09-01T00:17:07,146 adding 'lm_eval/tasks/mmlu_prox/uk/_mmlu_prox_uk.yaml' 2026-09-01T00:17:07,148 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_lite_template_yaml' 2026-09-01T00:17:07,149 adding 'lm_eval/tasks/mmlu_prox/uk/_uk_template_yaml' 2026-09-01T00:17:07,150 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_biology.yaml' 2026-09-01T00:17:07,151 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_business.yaml' 2026-09-01T00:17:07,153 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_chemistry.yaml' 2026-09-01T00:17:07,154 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_computer_science.yaml' 2026-09-01T00:17:07,155 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_economics.yaml' 2026-09-01T00:17:07,156 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_engineering.yaml' 2026-09-01T00:17:07,158 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_health.yaml' 2026-09-01T00:17:07,159 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_history.yaml' 2026-09-01T00:17:07,160 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_law.yaml' 2026-09-01T00:17:07,161 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_math.yaml' 2026-09-01T00:17:07,162 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_other.yaml' 2026-09-01T00:17:07,164 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_philosophy.yaml' 2026-09-01T00:17:07,165 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_physics.yaml' 2026-09-01T00:17:07,166 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_lite_uk_psychology.yaml' 2026-09-01T00:17:07,167 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_biology.yaml' 2026-09-01T00:17:07,168 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_business.yaml' 2026-09-01T00:17:07,170 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_chemistry.yaml' 2026-09-01T00:17:07,171 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_computer_science.yaml' 2026-09-01T00:17:07,172 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_economics.yaml' 2026-09-01T00:17:07,173 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_engineering.yaml' 2026-09-01T00:17:07,174 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_health.yaml' 2026-09-01T00:17:07,176 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_history.yaml' 2026-09-01T00:17:07,177 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_law.yaml' 2026-09-01T00:17:07,178 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_math.yaml' 2026-09-01T00:17:07,179 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_other.yaml' 2026-09-01T00:17:07,180 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_philosophy.yaml' 2026-09-01T00:17:07,181 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_physics.yaml' 2026-09-01T00:17:07,182 adding 'lm_eval/tasks/mmlu_prox/uk/mmlu_prox_uk_psychology.yaml' 2026-09-01T00:17:07,184 adding 'lm_eval/tasks/mmlu_prox/uk/utils.py' 2026-09-01T00:17:07,186 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_lite_ur.yaml' 2026-09-01T00:17:07,187 adding 'lm_eval/tasks/mmlu_prox/ur/_mmlu_prox_ur.yaml' 2026-09-01T00:17:07,189 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_lite_template_yaml' 2026-09-01T00:17:07,190 adding 'lm_eval/tasks/mmlu_prox/ur/_ur_template_yaml' 2026-09-01T00:17:07,191 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_biology.yaml' 2026-09-01T00:17:07,192 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_business.yaml' 2026-09-01T00:17:07,194 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_chemistry.yaml' 2026-09-01T00:17:07,195 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_computer_science.yaml' 2026-09-01T00:17:07,196 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_economics.yaml' 2026-09-01T00:17:07,197 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_engineering.yaml' 2026-09-01T00:17:07,199 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_health.yaml' 2026-09-01T00:17:07,200 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_history.yaml' 2026-09-01T00:17:07,201 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_law.yaml' 2026-09-01T00:17:07,202 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_math.yaml' 2026-09-01T00:17:07,203 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_other.yaml' 2026-09-01T00:17:07,205 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_philosophy.yaml' 2026-09-01T00:17:07,206 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_physics.yaml' 2026-09-01T00:17:07,207 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_lite_ur_psychology.yaml' 2026-09-01T00:17:07,208 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_biology.yaml' 2026-09-01T00:17:07,210 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_business.yaml' 2026-09-01T00:17:07,211 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_chemistry.yaml' 2026-09-01T00:17:07,212 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_computer_science.yaml' 2026-09-01T00:17:07,213 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_economics.yaml' 2026-09-01T00:17:07,214 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_engineering.yaml' 2026-09-01T00:17:07,216 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_health.yaml' 2026-09-01T00:17:07,217 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_history.yaml' 2026-09-01T00:17:07,218 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_law.yaml' 2026-09-01T00:17:07,219 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_math.yaml' 2026-09-01T00:17:07,220 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_other.yaml' 2026-09-01T00:17:07,222 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_philosophy.yaml' 2026-09-01T00:17:07,223 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_physics.yaml' 2026-09-01T00:17:07,224 adding 'lm_eval/tasks/mmlu_prox/ur/mmlu_prox_ur_psychology.yaml' 2026-09-01T00:17:07,225 adding 'lm_eval/tasks/mmlu_prox/ur/utils.py' 2026-09-01T00:17:07,227 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_lite_vi.yaml' 2026-09-01T00:17:07,228 adding 'lm_eval/tasks/mmlu_prox/vi/_mmlu_prox_vi.yaml' 2026-09-01T00:17:07,230 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_lite_template_yaml' 2026-09-01T00:17:07,231 adding 'lm_eval/tasks/mmlu_prox/vi/_vi_template_yaml' 2026-09-01T00:17:07,232 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_biology.yaml' 2026-09-01T00:17:07,233 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_business.yaml' 2026-09-01T00:17:07,234 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_chemistry.yaml' 2026-09-01T00:17:07,236 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_computer_science.yaml' 2026-09-01T00:17:07,237 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_economics.yaml' 2026-09-01T00:17:07,238 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_engineering.yaml' 2026-09-01T00:17:07,239 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_health.yaml' 2026-09-01T00:17:07,240 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_history.yaml' 2026-09-01T00:17:07,242 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_law.yaml' 2026-09-01T00:17:07,243 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_math.yaml' 2026-09-01T00:17:07,244 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_other.yaml' 2026-09-01T00:17:07,245 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_philosophy.yaml' 2026-09-01T00:17:07,246 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_physics.yaml' 2026-09-01T00:17:07,248 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_lite_vi_psychology.yaml' 2026-09-01T00:17:07,249 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_biology.yaml' 2026-09-01T00:17:07,250 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_business.yaml' 2026-09-01T00:17:07,251 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_chemistry.yaml' 2026-09-01T00:17:07,253 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_computer_science.yaml' 2026-09-01T00:17:07,254 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_economics.yaml' 2026-09-01T00:17:07,255 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_engineering.yaml' 2026-09-01T00:17:07,256 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_health.yaml' 2026-09-01T00:17:07,257 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_history.yaml' 2026-09-01T00:17:07,259 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_law.yaml' 2026-09-01T00:17:07,260 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_math.yaml' 2026-09-01T00:17:07,261 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_other.yaml' 2026-09-01T00:17:07,262 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_philosophy.yaml' 2026-09-01T00:17:07,264 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_physics.yaml' 2026-09-01T00:17:07,265 adding 'lm_eval/tasks/mmlu_prox/vi/mmlu_prox_vi_psychology.yaml' 2026-09-01T00:17:07,266 adding 'lm_eval/tasks/mmlu_prox/vi/utils.py' 2026-09-01T00:17:07,269 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_lite_wo.yaml' 2026-09-01T00:17:07,270 adding 'lm_eval/tasks/mmlu_prox/wo/_mmlu_prox_wo.yaml' 2026-09-01T00:17:07,271 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_lite_template_yaml' 2026-09-01T00:17:07,272 adding 'lm_eval/tasks/mmlu_prox/wo/_wo_template_yaml' 2026-09-01T00:17:07,274 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_biology.yaml' 2026-09-01T00:17:07,275 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_business.yaml' 2026-09-01T00:17:07,276 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_chemistry.yaml' 2026-09-01T00:17:07,277 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_computer_science.yaml' 2026-09-01T00:17:07,278 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_economics.yaml' 2026-09-01T00:17:07,280 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_engineering.yaml' 2026-09-01T00:17:07,281 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_health.yaml' 2026-09-01T00:17:07,282 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_history.yaml' 2026-09-01T00:17:07,283 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_law.yaml' 2026-09-01T00:17:07,284 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_math.yaml' 2026-09-01T00:17:07,285 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_other.yaml' 2026-09-01T00:17:07,286 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_philosophy.yaml' 2026-09-01T00:17:07,288 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_physics.yaml' 2026-09-01T00:17:07,289 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_lite_wo_psychology.yaml' 2026-09-01T00:17:07,290 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_biology.yaml' 2026-09-01T00:17:07,291 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_business.yaml' 2026-09-01T00:17:07,292 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_chemistry.yaml' 2026-09-01T00:17:07,293 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_computer_science.yaml' 2026-09-01T00:17:07,294 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_economics.yaml' 2026-09-01T00:17:07,296 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_engineering.yaml' 2026-09-01T00:17:07,297 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_health.yaml' 2026-09-01T00:17:07,298 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_history.yaml' 2026-09-01T00:17:07,299 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_law.yaml' 2026-09-01T00:17:07,300 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_math.yaml' 2026-09-01T00:17:07,301 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_other.yaml' 2026-09-01T00:17:07,302 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_philosophy.yaml' 2026-09-01T00:17:07,303 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_physics.yaml' 2026-09-01T00:17:07,305 adding 'lm_eval/tasks/mmlu_prox/wo/mmlu_prox_wo_psychology.yaml' 2026-09-01T00:17:07,306 adding 'lm_eval/tasks/mmlu_prox/wo/utils.py' 2026-09-01T00:17:07,308 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_lite_yo.yaml' 2026-09-01T00:17:07,309 adding 'lm_eval/tasks/mmlu_prox/yo/_mmlu_prox_yo.yaml' 2026-09-01T00:17:07,311 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_lite_template_yaml' 2026-09-01T00:17:07,312 adding 'lm_eval/tasks/mmlu_prox/yo/_yo_template_yaml' 2026-09-01T00:17:07,313 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_biology.yaml' 2026-09-01T00:17:07,314 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_business.yaml' 2026-09-01T00:17:07,316 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_chemistry.yaml' 2026-09-01T00:17:07,317 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_computer_science.yaml' 2026-09-01T00:17:07,318 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_economics.yaml' 2026-09-01T00:17:07,319 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_engineering.yaml' 2026-09-01T00:17:07,320 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_health.yaml' 2026-09-01T00:17:07,322 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_history.yaml' 2026-09-01T00:17:07,323 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_law.yaml' 2026-09-01T00:17:07,324 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_math.yaml' 2026-09-01T00:17:07,325 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_other.yaml' 2026-09-01T00:17:07,326 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_philosophy.yaml' 2026-09-01T00:17:07,328 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_physics.yaml' 2026-09-01T00:17:07,329 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_lite_yo_psychology.yaml' 2026-09-01T00:17:07,330 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_biology.yaml' 2026-09-01T00:17:07,331 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_business.yaml' 2026-09-01T00:17:07,333 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_chemistry.yaml' 2026-09-01T00:17:07,334 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_computer_science.yaml' 2026-09-01T00:17:07,335 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_economics.yaml' 2026-09-01T00:17:07,336 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_engineering.yaml' 2026-09-01T00:17:07,337 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_health.yaml' 2026-09-01T00:17:07,338 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_history.yaml' 2026-09-01T00:17:07,339 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_law.yaml' 2026-09-01T00:17:07,340 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_math.yaml' 2026-09-01T00:17:07,341 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_other.yaml' 2026-09-01T00:17:07,342 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_philosophy.yaml' 2026-09-01T00:17:07,344 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_physics.yaml' 2026-09-01T00:17:07,345 adding 'lm_eval/tasks/mmlu_prox/yo/mmlu_prox_yo_psychology.yaml' 2026-09-01T00:17:07,346 adding 'lm_eval/tasks/mmlu_prox/yo/utils.py' 2026-09-01T00:17:07,348 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_lite_zh.yaml' 2026-09-01T00:17:07,349 adding 'lm_eval/tasks/mmlu_prox/zh/_mmlu_prox_zh.yaml' 2026-09-01T00:17:07,351 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_lite_template_yaml' 2026-09-01T00:17:07,352 adding 'lm_eval/tasks/mmlu_prox/zh/_zh_template_yaml' 2026-09-01T00:17:07,353 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_biology.yaml' 2026-09-01T00:17:07,354 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_business.yaml' 2026-09-01T00:17:07,355 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_chemistry.yaml' 2026-09-01T00:17:07,356 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_computer_science.yaml' 2026-09-01T00:17:07,357 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_economics.yaml' 2026-09-01T00:17:07,359 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_engineering.yaml' 2026-09-01T00:17:07,360 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_health.yaml' 2026-09-01T00:17:07,361 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_history.yaml' 2026-09-01T00:17:07,362 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_law.yaml' 2026-09-01T00:17:07,363 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_math.yaml' 2026-09-01T00:17:07,365 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_other.yaml' 2026-09-01T00:17:07,366 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_philosophy.yaml' 2026-09-01T00:17:07,367 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_physics.yaml' 2026-09-01T00:17:07,368 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_lite_zh_psychology.yaml' 2026-09-01T00:17:07,369 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_biology.yaml' 2026-09-01T00:17:07,370 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_business.yaml' 2026-09-01T00:17:07,372 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_chemistry.yaml' 2026-09-01T00:17:07,373 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_computer_science.yaml' 2026-09-01T00:17:07,374 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_economics.yaml' 2026-09-01T00:17:07,375 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_engineering.yaml' 2026-09-01T00:17:07,377 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_health.yaml' 2026-09-01T00:17:07,378 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_history.yaml' 2026-09-01T00:17:07,379 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_law.yaml' 2026-09-01T00:17:07,380 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_math.yaml' 2026-09-01T00:17:07,381 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_other.yaml' 2026-09-01T00:17:07,383 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_philosophy.yaml' 2026-09-01T00:17:07,384 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_physics.yaml' 2026-09-01T00:17:07,385 adding 'lm_eval/tasks/mmlu_prox/zh/mmlu_prox_zh_psychology.yaml' 2026-09-01T00:17:07,386 adding 'lm_eval/tasks/mmlu_prox/zh/utils.py' 2026-09-01T00:17:07,389 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_lite_zu.yaml' 2026-09-01T00:17:07,390 adding 'lm_eval/tasks/mmlu_prox/zu/_mmlu_prox_zu.yaml' 2026-09-01T00:17:07,391 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_lite_template_yaml' 2026-09-01T00:17:07,392 adding 'lm_eval/tasks/mmlu_prox/zu/_zu_template_yaml' 2026-09-01T00:17:07,393 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_biology.yaml' 2026-09-01T00:17:07,395 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_business.yaml' 2026-09-01T00:17:07,396 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_chemistry.yaml' 2026-09-01T00:17:07,397 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_computer_science.yaml' 2026-09-01T00:17:07,398 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_economics.yaml' 2026-09-01T00:17:07,399 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_engineering.yaml' 2026-09-01T00:17:07,400 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_health.yaml' 2026-09-01T00:17:07,401 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_history.yaml' 2026-09-01T00:17:07,402 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_law.yaml' 2026-09-01T00:17:07,404 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_math.yaml' 2026-09-01T00:17:07,405 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_other.yaml' 2026-09-01T00:17:07,406 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_philosophy.yaml' 2026-09-01T00:17:07,407 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_physics.yaml' 2026-09-01T00:17:07,408 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_lite_zu_psychology.yaml' 2026-09-01T00:17:07,409 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_biology.yaml' 2026-09-01T00:17:07,410 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_business.yaml' 2026-09-01T00:17:07,412 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_chemistry.yaml' 2026-09-01T00:17:07,413 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_computer_science.yaml' 2026-09-01T00:17:07,414 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_economics.yaml' 2026-09-01T00:17:07,415 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_engineering.yaml' 2026-09-01T00:17:07,416 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_health.yaml' 2026-09-01T00:17:07,418 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_history.yaml' 2026-09-01T00:17:07,419 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_law.yaml' 2026-09-01T00:17:07,420 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_math.yaml' 2026-09-01T00:17:07,421 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_other.yaml' 2026-09-01T00:17:07,422 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_philosophy.yaml' 2026-09-01T00:17:07,423 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_physics.yaml' 2026-09-01T00:17:07,425 adding 'lm_eval/tasks/mmlu_prox/zu/mmlu_prox_zu_psychology.yaml' 2026-09-01T00:17:07,426 adding 'lm_eval/tasks/mmlu_prox/zu/utils.py' 2026-09-01T00:17:07,428 adding 'lm_eval/tasks/mmlusr/README.md' 2026-09-01T00:17:07,430 adding 'lm_eval/tasks/mmlusr/config.py' 2026-09-01T00:17:07,433 adding 'lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml' 2026-09-01T00:17:07,434 adding 'lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml' 2026-09-01T00:17:07,435 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml' 2026-09-01T00:17:07,437 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml' 2026-09-01T00:17:07,438 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml' 2026-09-01T00:17:07,439 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml' 2026-09-01T00:17:07,440 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml' 2026-09-01T00:17:07,442 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml' 2026-09-01T00:17:07,443 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml' 2026-09-01T00:17:07,444 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml' 2026-09-01T00:17:07,445 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml' 2026-09-01T00:17:07,446 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml' 2026-09-01T00:17:07,448 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml' 2026-09-01T00:17:07,449 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml' 2026-09-01T00:17:07,450 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml' 2026-09-01T00:17:07,451 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml' 2026-09-01T00:17:07,452 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml' 2026-09-01T00:17:07,453 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml' 2026-09-01T00:17:07,454 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml' 2026-09-01T00:17:07,455 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml' 2026-09-01T00:17:07,457 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml' 2026-09-01T00:17:07,458 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml' 2026-09-01T00:17:07,459 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml' 2026-09-01T00:17:07,460 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml' 2026-09-01T00:17:07,461 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml' 2026-09-01T00:17:07,462 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml' 2026-09-01T00:17:07,463 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml' 2026-09-01T00:17:07,465 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml' 2026-09-01T00:17:07,466 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml' 2026-09-01T00:17:07,467 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml' 2026-09-01T00:17:07,468 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml' 2026-09-01T00:17:07,469 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml' 2026-09-01T00:17:07,471 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml' 2026-09-01T00:17:07,472 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml' 2026-09-01T00:17:07,473 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml' 2026-09-01T00:17:07,474 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml' 2026-09-01T00:17:07,475 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml' 2026-09-01T00:17:07,477 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml' 2026-09-01T00:17:07,478 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml' 2026-09-01T00:17:07,479 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml' 2026-09-01T00:17:07,480 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml' 2026-09-01T00:17:07,481 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml' 2026-09-01T00:17:07,483 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml' 2026-09-01T00:17:07,484 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml' 2026-09-01T00:17:07,485 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml' 2026-09-01T00:17:07,486 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml' 2026-09-01T00:17:07,487 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml' 2026-09-01T00:17:07,489 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml' 2026-09-01T00:17:07,490 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml' 2026-09-01T00:17:07,491 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml' 2026-09-01T00:17:07,492 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml' 2026-09-01T00:17:07,493 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml' 2026-09-01T00:17:07,495 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml' 2026-09-01T00:17:07,496 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml' 2026-09-01T00:17:07,497 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml' 2026-09-01T00:17:07,498 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml' 2026-09-01T00:17:07,499 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml' 2026-09-01T00:17:07,500 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml' 2026-09-01T00:17:07,501 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml' 2026-09-01T00:17:07,502 adding 'lm_eval/tasks/mmlusr/answer_only/utils.py' 2026-09-01T00:17:07,505 adding 'lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml' 2026-09-01T00:17:07,506 adding 'lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml' 2026-09-01T00:17:07,507 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml' 2026-09-01T00:17:07,509 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml' 2026-09-01T00:17:07,510 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml' 2026-09-01T00:17:07,511 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml' 2026-09-01T00:17:07,512 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml' 2026-09-01T00:17:07,513 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml' 2026-09-01T00:17:07,514 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml' 2026-09-01T00:17:07,515 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml' 2026-09-01T00:17:07,517 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml' 2026-09-01T00:17:07,518 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml' 2026-09-01T00:17:07,519 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml' 2026-09-01T00:17:07,520 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml' 2026-09-01T00:17:07,521 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml' 2026-09-01T00:17:07,523 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml' 2026-09-01T00:17:07,524 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml' 2026-09-01T00:17:07,525 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml' 2026-09-01T00:17:07,526 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml' 2026-09-01T00:17:07,527 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml' 2026-09-01T00:17:07,529 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml' 2026-09-01T00:17:07,530 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml' 2026-09-01T00:17:07,531 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml' 2026-09-01T00:17:07,532 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml' 2026-09-01T00:17:07,533 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml' 2026-09-01T00:17:07,535 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml' 2026-09-01T00:17:07,536 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml' 2026-09-01T00:17:07,537 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml' 2026-09-01T00:17:07,538 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml' 2026-09-01T00:17:07,540 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml' 2026-09-01T00:17:07,541 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml' 2026-09-01T00:17:07,542 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml' 2026-09-01T00:17:07,543 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml' 2026-09-01T00:17:07,544 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml' 2026-09-01T00:17:07,545 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml' 2026-09-01T00:17:07,546 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml' 2026-09-01T00:17:07,547 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml' 2026-09-01T00:17:07,549 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml' 2026-09-01T00:17:07,550 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml' 2026-09-01T00:17:07,551 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml' 2026-09-01T00:17:07,552 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml' 2026-09-01T00:17:07,553 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml' 2026-09-01T00:17:07,554 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml' 2026-09-01T00:17:07,555 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml' 2026-09-01T00:17:07,557 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml' 2026-09-01T00:17:07,558 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml' 2026-09-01T00:17:07,559 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml' 2026-09-01T00:17:07,560 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml' 2026-09-01T00:17:07,561 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml' 2026-09-01T00:17:07,563 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml' 2026-09-01T00:17:07,564 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml' 2026-09-01T00:17:07,565 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml' 2026-09-01T00:17:07,566 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml' 2026-09-01T00:17:07,567 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml' 2026-09-01T00:17:07,569 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml' 2026-09-01T00:17:07,570 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml' 2026-09-01T00:17:07,571 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml' 2026-09-01T00:17:07,572 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml' 2026-09-01T00:17:07,574 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml' 2026-09-01T00:17:07,575 adding 'lm_eval/tasks/mmlusr/question_and_answer/utils.py' 2026-09-01T00:17:07,578 adding 'lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml' 2026-09-01T00:17:07,579 adding 'lm_eval/tasks/mmlusr/question_only/_question_only.yaml' 2026-09-01T00:17:07,580 adding 'lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml' 2026-09-01T00:17:07,581 adding 'lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml' 2026-09-01T00:17:07,583 adding 'lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml' 2026-09-01T00:17:07,584 adding 'lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml' 2026-09-01T00:17:07,585 adding 'lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml' 2026-09-01T00:17:07,586 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml' 2026-09-01T00:17:07,587 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml' 2026-09-01T00:17:07,588 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml' 2026-09-01T00:17:07,589 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml' 2026-09-01T00:17:07,590 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml' 2026-09-01T00:17:07,591 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml' 2026-09-01T00:17:07,592 adding 'lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml' 2026-09-01T00:17:07,594 adding 'lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml' 2026-09-01T00:17:07,595 adding 'lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml' 2026-09-01T00:17:07,596 adding 'lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml' 2026-09-01T00:17:07,597 adding 'lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml' 2026-09-01T00:17:07,598 adding 'lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml' 2026-09-01T00:17:07,600 adding 'lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml' 2026-09-01T00:17:07,601 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml' 2026-09-01T00:17:07,602 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml' 2026-09-01T00:17:07,603 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml' 2026-09-01T00:17:07,604 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml' 2026-09-01T00:17:07,606 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml' 2026-09-01T00:17:07,607 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml' 2026-09-01T00:17:07,608 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml' 2026-09-01T00:17:07,609 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml' 2026-09-01T00:17:07,611 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml' 2026-09-01T00:17:07,612 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml' 2026-09-01T00:17:07,613 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml' 2026-09-01T00:17:07,615 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml' 2026-09-01T00:17:07,616 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml' 2026-09-01T00:17:07,617 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml' 2026-09-01T00:17:07,619 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml' 2026-09-01T00:17:07,620 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml' 2026-09-01T00:17:07,621 adding 'lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml' 2026-09-01T00:17:07,622 adding 'lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml' 2026-09-01T00:17:07,623 adding 'lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml' 2026-09-01T00:17:07,624 adding 'lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml' 2026-09-01T00:17:07,626 adding 'lm_eval/tasks/mmlusr/question_only/question_only_management.yaml' 2026-09-01T00:17:07,627 adding 'lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml' 2026-09-01T00:17:07,628 adding 'lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml' 2026-09-01T00:17:07,629 adding 'lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml' 2026-09-01T00:17:07,630 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml' 2026-09-01T00:17:07,631 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml' 2026-09-01T00:17:07,632 adding 'lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml' 2026-09-01T00:17:07,633 adding 'lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml' 2026-09-01T00:17:07,635 adding 'lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml' 2026-09-01T00:17:07,636 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml' 2026-09-01T00:17:07,637 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml' 2026-09-01T00:17:07,638 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml' 2026-09-01T00:17:07,639 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml' 2026-09-01T00:17:07,641 adding 'lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml' 2026-09-01T00:17:07,642 adding 'lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml' 2026-09-01T00:17:07,643 adding 'lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml' 2026-09-01T00:17:07,644 adding 'lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml' 2026-09-01T00:17:07,645 adding 'lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml' 2026-09-01T00:17:07,647 adding 'lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml' 2026-09-01T00:17:07,648 adding 'lm_eval/tasks/mmlusr/question_only/utils.py' 2026-09-01T00:17:07,651 adding 'lm_eval/tasks/mmmu/README.md' 2026-09-01T00:17:07,652 adding 'lm_eval/tasks/mmmu/_art_and_design.yaml' 2026-09-01T00:17:07,653 adding 'lm_eval/tasks/mmmu/_business.yaml' 2026-09-01T00:17:07,655 adding 'lm_eval/tasks/mmmu/_health_and_medicine.yaml' 2026-09-01T00:17:07,656 adding 'lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml' 2026-09-01T00:17:07,658 adding 'lm_eval/tasks/mmmu/_mmmu.yaml' 2026-09-01T00:17:07,659 adding 'lm_eval/tasks/mmmu/_science.yaml' 2026-09-01T00:17:07,660 adding 'lm_eval/tasks/mmmu/_tech_and_engineering.yaml' 2026-09-01T00:17:07,661 adding 'lm_eval/tasks/mmmu/_template_yaml' 2026-09-01T00:17:07,662 adding 'lm_eval/tasks/mmmu/mmmu_accounting.yaml' 2026-09-01T00:17:07,664 adding 'lm_eval/tasks/mmmu/mmmu_agriculture.yaml' 2026-09-01T00:17:07,665 adding 'lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml' 2026-09-01T00:17:07,666 adding 'lm_eval/tasks/mmmu/mmmu_art.yaml' 2026-09-01T00:17:07,667 adding 'lm_eval/tasks/mmmu/mmmu_art_theory.yaml' 2026-09-01T00:17:07,668 adding 'lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml' 2026-09-01T00:17:07,669 adding 'lm_eval/tasks/mmmu/mmmu_biology.yaml' 2026-09-01T00:17:07,671 adding 'lm_eval/tasks/mmmu/mmmu_chemistry.yaml' 2026-09-01T00:17:07,672 adding 'lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml' 2026-09-01T00:17:07,673 adding 'lm_eval/tasks/mmmu/mmmu_computer_science.yaml' 2026-09-01T00:17:07,674 adding 'lm_eval/tasks/mmmu/mmmu_design.yaml' 2026-09-01T00:17:07,675 adding 'lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml' 2026-09-01T00:17:07,677 adding 'lm_eval/tasks/mmmu/mmmu_economics.yaml' 2026-09-01T00:17:07,678 adding 'lm_eval/tasks/mmmu/mmmu_electronics.yaml' 2026-09-01T00:17:07,679 adding 'lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml' 2026-09-01T00:17:07,681 adding 'lm_eval/tasks/mmmu/mmmu_finance.yaml' 2026-09-01T00:17:07,682 adding 'lm_eval/tasks/mmmu/mmmu_geography.yaml' 2026-09-01T00:17:07,683 adding 'lm_eval/tasks/mmmu/mmmu_history.yaml' 2026-09-01T00:17:07,684 adding 'lm_eval/tasks/mmmu/mmmu_literature.yaml' 2026-09-01T00:17:07,686 adding 'lm_eval/tasks/mmmu/mmmu_manage.yaml' 2026-09-01T00:17:07,687 adding 'lm_eval/tasks/mmmu/mmmu_marketing.yaml' 2026-09-01T00:17:07,688 adding 'lm_eval/tasks/mmmu/mmmu_materials.yaml' 2026-09-01T00:17:07,689 adding 'lm_eval/tasks/mmmu/mmmu_math.yaml' 2026-09-01T00:17:07,690 adding 'lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml' 2026-09-01T00:17:07,691 adding 'lm_eval/tasks/mmmu/mmmu_music.yaml' 2026-09-01T00:17:07,693 adding 'lm_eval/tasks/mmmu/mmmu_pharmacy.yaml' 2026-09-01T00:17:07,694 adding 'lm_eval/tasks/mmmu/mmmu_physics.yaml' 2026-09-01T00:17:07,695 adding 'lm_eval/tasks/mmmu/mmmu_psychology.yaml' 2026-09-01T00:17:07,697 adding 'lm_eval/tasks/mmmu/mmmu_public_health.yaml' 2026-09-01T00:17:07,698 adding 'lm_eval/tasks/mmmu/mmmu_sociology.yaml' 2026-09-01T00:17:07,701 adding 'lm_eval/tasks/mmmu/utils.py' 2026-09-01T00:17:07,704 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py' 2026-09-01T00:17:07,706 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml' 2026-09-01T00:17:07,707 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml' 2026-09-01T00:17:07,708 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml' 2026-09-01T00:17:07,709 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml' 2026-09-01T00:17:07,710 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml' 2026-09-01T00:17:07,711 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml' 2026-09-01T00:17:07,713 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml' 2026-09-01T00:17:07,714 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml' 2026-09-01T00:17:07,715 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml' 2026-09-01T00:17:07,717 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml' 2026-09-01T00:17:07,718 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml' 2026-09-01T00:17:07,719 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml' 2026-09-01T00:17:07,720 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml' 2026-09-01T00:17:07,721 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml' 2026-09-01T00:17:07,723 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml' 2026-09-01T00:17:07,724 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml' 2026-09-01T00:17:07,725 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml' 2026-09-01T00:17:07,726 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml' 2026-09-01T00:17:07,728 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml' 2026-09-01T00:17:07,729 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml' 2026-09-01T00:17:07,730 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml' 2026-09-01T00:17:07,731 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml' 2026-09-01T00:17:07,733 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml' 2026-09-01T00:17:07,734 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml' 2026-09-01T00:17:07,735 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml' 2026-09-01T00:17:07,736 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml' 2026-09-01T00:17:07,738 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml' 2026-09-01T00:17:07,739 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml' 2026-09-01T00:17:07,742 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml' 2026-09-01T00:17:07,777 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml' 2026-09-01T00:17:07,778 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml' 2026-09-01T00:17:07,779 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml' 2026-09-01T00:17:07,781 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml' 2026-09-01T00:17:07,782 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml' 2026-09-01T00:17:07,784 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml' 2026-09-01T00:17:07,785 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml' 2026-09-01T00:17:07,786 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml' 2026-09-01T00:17:07,788 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml' 2026-09-01T00:17:07,789 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml' 2026-09-01T00:17:07,790 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml' 2026-09-01T00:17:07,791 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml' 2026-09-01T00:17:07,792 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml' 2026-09-01T00:17:07,793 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml' 2026-09-01T00:17:07,795 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml' 2026-09-01T00:17:07,796 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml' 2026-09-01T00:17:07,797 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml' 2026-09-01T00:17:07,798 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml' 2026-09-01T00:17:07,799 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml' 2026-09-01T00:17:07,800 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml' 2026-09-01T00:17:07,802 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml' 2026-09-01T00:17:07,806 adding 'lm_eval/tasks/model_written_evals/persona/_generate_configs.py' 2026-09-01T00:17:07,808 adding 'lm_eval/tasks/model_written_evals/persona/_template_yaml' 2026-09-01T00:17:07,809 adding 'lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml' 2026-09-01T00:17:07,811 adding 'lm_eval/tasks/model_written_evals/persona/agreeableness.yaml' 2026-09-01T00:17:07,812 adding 'lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml' 2026-09-01T00:17:07,813 adding 'lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml' 2026-09-01T00:17:07,814 adding 'lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml' 2026-09-01T00:17:07,816 adding 'lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml' 2026-09-01T00:17:07,817 adding 'lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml' 2026-09-01T00:17:07,818 adding 'lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml' 2026-09-01T00:17:07,819 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml' 2026-09-01T00:17:07,820 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml' 2026-09-01T00:17:07,821 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml' 2026-09-01T00:17:07,822 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml' 2026-09-01T00:17:07,823 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml' 2026-09-01T00:17:07,825 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml' 2026-09-01T00:17:07,826 adding 'lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml' 2026-09-01T00:17:07,827 adding 'lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml' 2026-09-01T00:17:07,828 adding 'lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml' 2026-09-01T00:17:07,829 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml' 2026-09-01T00:17:07,830 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml' 2026-09-01T00:17:07,832 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml' 2026-09-01T00:17:07,833 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml' 2026-09-01T00:17:07,834 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml' 2026-09-01T00:17:07,835 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml' 2026-09-01T00:17:07,836 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml' 2026-09-01T00:17:07,837 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml' 2026-09-01T00:17:07,838 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml' 2026-09-01T00:17:07,840 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml' 2026-09-01T00:17:07,841 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml' 2026-09-01T00:17:07,842 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml' 2026-09-01T00:17:07,843 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml' 2026-09-01T00:17:07,844 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml' 2026-09-01T00:17:07,846 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml' 2026-09-01T00:17:07,847 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml' 2026-09-01T00:17:07,848 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml' 2026-09-01T00:17:07,849 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml' 2026-09-01T00:17:07,850 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml' 2026-09-01T00:17:07,852 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml' 2026-09-01T00:17:07,853 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml' 2026-09-01T00:17:07,854 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml' 2026-09-01T00:17:07,855 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml' 2026-09-01T00:17:07,856 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml' 2026-09-01T00:17:07,857 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml' 2026-09-01T00:17:07,859 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml' 2026-09-01T00:17:07,860 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml' 2026-09-01T00:17:07,861 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml' 2026-09-01T00:17:07,862 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml' 2026-09-01T00:17:07,863 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml' 2026-09-01T00:17:07,864 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml' 2026-09-01T00:17:07,865 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml' 2026-09-01T00:17:07,867 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml' 2026-09-01T00:17:07,868 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml' 2026-09-01T00:17:07,869 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml' 2026-09-01T00:17:07,870 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml' 2026-09-01T00:17:07,871 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml' 2026-09-01T00:17:07,872 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml' 2026-09-01T00:17:07,873 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml' 2026-09-01T00:17:07,875 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml' 2026-09-01T00:17:07,876 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml' 2026-09-01T00:17:07,877 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml' 2026-09-01T00:17:07,878 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml' 2026-09-01T00:17:07,879 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml' 2026-09-01T00:17:07,880 adding 'lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml' 2026-09-01T00:17:07,882 adding 'lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml' 2026-09-01T00:17:07,883 adding 'lm_eval/tasks/model_written_evals/persona/extraversion.yaml' 2026-09-01T00:17:07,884 adding 'lm_eval/tasks/model_written_evals/persona/has-disability.yaml' 2026-09-01T00:17:07,885 adding 'lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml' 2026-09-01T00:17:07,886 adding 'lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml' 2026-09-01T00:17:07,887 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml' 2026-09-01T00:17:07,888 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml' 2026-09-01T00:17:07,890 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml' 2026-09-01T00:17:07,891 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml' 2026-09-01T00:17:07,892 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml' 2026-09-01T00:17:07,893 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml' 2026-09-01T00:17:07,894 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml' 2026-09-01T00:17:07,896 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml' 2026-09-01T00:17:07,897 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml' 2026-09-01T00:17:07,898 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml' 2026-09-01T00:17:07,899 adding 'lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml' 2026-09-01T00:17:07,900 adding 'lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml' 2026-09-01T00:17:07,902 adding 'lm_eval/tasks/model_written_evals/persona/narcissism.yaml' 2026-09-01T00:17:07,903 adding 'lm_eval/tasks/model_written_evals/persona/neuroticism.yaml' 2026-09-01T00:17:07,904 adding 'lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml' 2026-09-01T00:17:07,905 adding 'lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml' 2026-09-01T00:17:07,906 adding 'lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml' 2026-09-01T00:17:07,907 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml' 2026-09-01T00:17:07,908 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml' 2026-09-01T00:17:07,909 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml' 2026-09-01T00:17:07,910 adding 'lm_eval/tasks/model_written_evals/persona/openness.yaml' 2026-09-01T00:17:07,911 adding 'lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml' 2026-09-01T00:17:07,912 adding 'lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml' 2026-09-01T00:17:07,913 adding 'lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml' 2026-09-01T00:17:07,914 adding 'lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml' 2026-09-01T00:17:07,916 adding 'lm_eval/tasks/model_written_evals/persona/psychopathy.yaml' 2026-09-01T00:17:07,917 adding 'lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml' 2026-09-01T00:17:07,918 adding 'lm_eval/tasks/model_written_evals/persona/risk-averse.yaml' 2026-09-01T00:17:07,919 adding 'lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml' 2026-09-01T00:17:07,920 adding 'lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml' 2026-09-01T00:17:07,921 adding 'lm_eval/tasks/model_written_evals/persona/self-replication.yaml' 2026-09-01T00:17:07,922 adding 'lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml' 2026-09-01T00:17:07,924 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml' 2026-09-01T00:17:07,925 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml' 2026-09-01T00:17:07,926 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml' 2026-09-01T00:17:07,927 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml' 2026-09-01T00:17:07,928 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml' 2026-09-01T00:17:07,929 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml' 2026-09-01T00:17:07,931 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml' 2026-09-01T00:17:07,932 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml' 2026-09-01T00:17:07,933 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml' 2026-09-01T00:17:07,934 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml' 2026-09-01T00:17:07,935 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml' 2026-09-01T00:17:07,937 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml' 2026-09-01T00:17:07,938 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml' 2026-09-01T00:17:07,939 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml' 2026-09-01T00:17:07,940 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml' 2026-09-01T00:17:07,941 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml' 2026-09-01T00:17:07,942 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml' 2026-09-01T00:17:07,944 adding 'lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml' 2026-09-01T00:17:07,945 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml' 2026-09-01T00:17:07,947 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml' 2026-09-01T00:17:07,948 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml' 2026-09-01T00:17:07,949 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml' 2026-09-01T00:17:07,951 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml' 2026-09-01T00:17:07,952 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml' 2026-09-01T00:17:07,953 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml' 2026-09-01T00:17:07,954 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml' 2026-09-01T00:17:07,955 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml' 2026-09-01T00:17:07,957 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml' 2026-09-01T00:17:07,958 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml' 2026-09-01T00:17:07,959 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml' 2026-09-01T00:17:07,960 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml' 2026-09-01T00:17:07,961 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml' 2026-09-01T00:17:07,962 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml' 2026-09-01T00:17:07,964 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml' 2026-09-01T00:17:07,965 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml' 2026-09-01T00:17:07,966 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml' 2026-09-01T00:17:07,968 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml' 2026-09-01T00:17:07,969 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml' 2026-09-01T00:17:07,970 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml' 2026-09-01T00:17:07,972 adding 'lm_eval/tasks/model_written_evals/winogenerated/winogenerated' 2026-09-01T00:17:07,974 adding 'lm_eval/tasks/moral_stories/README.md' 2026-09-01T00:17:07,975 adding 'lm_eval/tasks/moral_stories/moral_stories.yaml' 2026-09-01T00:17:07,976 adding 'lm_eval/tasks/moral_stories/utils.py' 2026-09-01T00:17:07,978 adding 'lm_eval/tasks/mts_dialog/README.md' 2026-09-01T00:17:07,980 adding 'lm_eval/tasks/mts_dialog/mts_dialog.yaml' 2026-09-01T00:17:07,981 adding 'lm_eval/tasks/mts_dialog/mts_dialog_perplexity.yaml' 2026-09-01T00:17:07,982 adding 'lm_eval/tasks/mts_dialog/utils.py' 2026-09-01T00:17:07,983 adding 'lm_eval/tasks/mts_dialog/utils_perplexity.py' 2026-09-01T00:17:07,987 adding 'lm_eval/tasks/multiblimp/README.md' 2026-09-01T00:17:07,988 adding 'lm_eval/tasks/multiblimp/_template_yaml' 2026-09-01T00:17:07,990 adding 'lm_eval/tasks/multiblimp/multiblimp_abk.yaml' 2026-09-01T00:17:07,991 adding 'lm_eval/tasks/multiblimp/multiblimp_aln.yaml' 2026-09-01T00:17:07,992 adding 'lm_eval/tasks/multiblimp/multiblimp_amh.yaml' 2026-09-01T00:17:07,993 adding 'lm_eval/tasks/multiblimp/multiblimp_apu.yaml' 2026-09-01T00:17:07,994 adding 'lm_eval/tasks/multiblimp/multiblimp_aqz.yaml' 2026-09-01T00:17:07,995 adding 'lm_eval/tasks/multiblimp/multiblimp_arb.yaml' 2026-09-01T00:17:07,996 adding 'lm_eval/tasks/multiblimp/multiblimp_azz.yaml' 2026-09-01T00:17:07,997 adding 'lm_eval/tasks/multiblimp/multiblimp_bel.yaml' 2026-09-01T00:17:07,999 adding 'lm_eval/tasks/multiblimp/multiblimp_ben.yaml' 2026-09-01T00:17:08,000 adding 'lm_eval/tasks/multiblimp/multiblimp_bho.yaml' 2026-09-01T00:17:08,001 adding 'lm_eval/tasks/multiblimp/multiblimp_bor.yaml' 2026-09-01T00:17:08,002 adding 'lm_eval/tasks/multiblimp/multiblimp_bre.yaml' 2026-09-01T00:17:08,003 adding 'lm_eval/tasks/multiblimp/multiblimp_bua.yaml' 2026-09-01T00:17:08,004 adding 'lm_eval/tasks/multiblimp/multiblimp_bul.yaml' 2026-09-01T00:17:08,005 adding 'lm_eval/tasks/multiblimp/multiblimp_cat.yaml' 2026-09-01T00:17:08,006 adding 'lm_eval/tasks/multiblimp/multiblimp_ces.yaml' 2026-09-01T00:17:08,007 adding 'lm_eval/tasks/multiblimp/multiblimp_chu.yaml' 2026-09-01T00:17:08,008 adding 'lm_eval/tasks/multiblimp/multiblimp_cym.yaml' 2026-09-01T00:17:08,010 adding 'lm_eval/tasks/multiblimp/multiblimp_dan.yaml' 2026-09-01T00:17:08,011 adding 'lm_eval/tasks/multiblimp/multiblimp_deu.yaml' 2026-09-01T00:17:08,012 adding 'lm_eval/tasks/multiblimp/multiblimp_egy.yaml' 2026-09-01T00:17:08,013 adding 'lm_eval/tasks/multiblimp/multiblimp_ell.yaml' 2026-09-01T00:17:08,014 adding 'lm_eval/tasks/multiblimp/multiblimp_eng.yaml' 2026-09-01T00:17:08,015 adding 'lm_eval/tasks/multiblimp/multiblimp_est.yaml' 2026-09-01T00:17:08,016 adding 'lm_eval/tasks/multiblimp/multiblimp_eus.yaml' 2026-09-01T00:17:08,017 adding 'lm_eval/tasks/multiblimp/multiblimp_fao.yaml' 2026-09-01T00:17:08,018 adding 'lm_eval/tasks/multiblimp/multiblimp_fas.yaml' 2026-09-01T00:17:08,019 adding 'lm_eval/tasks/multiblimp/multiblimp_fin.yaml' 2026-09-01T00:17:08,021 adding 'lm_eval/tasks/multiblimp/multiblimp_fra.yaml' 2026-09-01T00:17:08,022 adding 'lm_eval/tasks/multiblimp/multiblimp_frm.yaml' 2026-09-01T00:17:08,023 adding 'lm_eval/tasks/multiblimp/multiblimp_fro.yaml' 2026-09-01T00:17:08,024 adding 'lm_eval/tasks/multiblimp/multiblimp_gla.yaml' 2026-09-01T00:17:08,025 adding 'lm_eval/tasks/multiblimp/multiblimp_gle.yaml' 2026-09-01T00:17:08,026 adding 'lm_eval/tasks/multiblimp/multiblimp_glg.yaml' 2026-09-01T00:17:08,027 adding 'lm_eval/tasks/multiblimp/multiblimp_got.yaml' 2026-09-01T00:17:08,029 adding 'lm_eval/tasks/multiblimp/multiblimp_grc.yaml' 2026-09-01T00:17:08,030 adding 'lm_eval/tasks/multiblimp/multiblimp_guj.yaml' 2026-09-01T00:17:08,031 adding 'lm_eval/tasks/multiblimp/multiblimp_hbo.yaml' 2026-09-01T00:17:08,032 adding 'lm_eval/tasks/multiblimp/multiblimp_hbs.yaml' 2026-09-01T00:17:08,033 adding 'lm_eval/tasks/multiblimp/multiblimp_heb.yaml' 2026-09-01T00:17:08,035 adding 'lm_eval/tasks/multiblimp/multiblimp_hin.yaml' 2026-09-01T00:17:08,036 adding 'lm_eval/tasks/multiblimp/multiblimp_hit.yaml' 2026-09-01T00:17:08,037 adding 'lm_eval/tasks/multiblimp/multiblimp_hsb.yaml' 2026-09-01T00:17:08,038 adding 'lm_eval/tasks/multiblimp/multiblimp_hun.yaml' 2026-09-01T00:17:08,039 adding 'lm_eval/tasks/multiblimp/multiblimp_hye.yaml' 2026-09-01T00:17:08,040 adding 'lm_eval/tasks/multiblimp/multiblimp_hyw.yaml' 2026-09-01T00:17:08,042 adding 'lm_eval/tasks/multiblimp/multiblimp_isl.yaml' 2026-09-01T00:17:08,043 adding 'lm_eval/tasks/multiblimp/multiblimp_ita.yaml' 2026-09-01T00:17:08,044 adding 'lm_eval/tasks/multiblimp/multiblimp_kat.yaml' 2026-09-01T00:17:08,045 adding 'lm_eval/tasks/multiblimp/multiblimp_kaz.yaml' 2026-09-01T00:17:08,046 adding 'lm_eval/tasks/multiblimp/multiblimp_kir.yaml' 2026-09-01T00:17:08,047 adding 'lm_eval/tasks/multiblimp/multiblimp_kmr.yaml' 2026-09-01T00:17:08,049 adding 'lm_eval/tasks/multiblimp/multiblimp_koi.yaml' 2026-09-01T00:17:08,050 adding 'lm_eval/tasks/multiblimp/multiblimp_kpv.yaml' 2026-09-01T00:17:08,051 adding 'lm_eval/tasks/multiblimp/multiblimp_krl.yaml' 2026-09-01T00:17:08,052 adding 'lm_eval/tasks/multiblimp/multiblimp_kxh.yaml' 2026-09-01T00:17:08,053 adding 'lm_eval/tasks/multiblimp/multiblimp_lat.yaml' 2026-09-01T00:17:08,054 adding 'lm_eval/tasks/multiblimp/multiblimp_lav.yaml' 2026-09-01T00:17:08,055 adding 'lm_eval/tasks/multiblimp/multiblimp_lij.yaml' 2026-09-01T00:17:08,056 adding 'lm_eval/tasks/multiblimp/multiblimp_lit.yaml' 2026-09-01T00:17:08,057 adding 'lm_eval/tasks/multiblimp/multiblimp_mar.yaml' 2026-09-01T00:17:08,058 adding 'lm_eval/tasks/multiblimp/multiblimp_mdf.yaml' 2026-09-01T00:17:08,059 adding 'lm_eval/tasks/multiblimp/multiblimp_mkd.yaml' 2026-09-01T00:17:08,061 adding 'lm_eval/tasks/multiblimp/multiblimp_myv.yaml' 2026-09-01T00:17:08,062 adding 'lm_eval/tasks/multiblimp/multiblimp_nds.yaml' 2026-09-01T00:17:08,063 adding 'lm_eval/tasks/multiblimp/multiblimp_nhi.yaml' 2026-09-01T00:17:08,064 adding 'lm_eval/tasks/multiblimp/multiblimp_nld.yaml' 2026-09-01T00:17:08,065 adding 'lm_eval/tasks/multiblimp/multiblimp_olo.yaml' 2026-09-01T00:17:08,066 adding 'lm_eval/tasks/multiblimp/multiblimp_orv.yaml' 2026-09-01T00:17:08,067 adding 'lm_eval/tasks/multiblimp/multiblimp_ota.yaml' 2026-09-01T00:17:08,068 adding 'lm_eval/tasks/multiblimp/multiblimp_pcm.yaml' 2026-09-01T00:17:08,069 adding 'lm_eval/tasks/multiblimp/multiblimp_pol.yaml' 2026-09-01T00:17:08,070 adding 'lm_eval/tasks/multiblimp/multiblimp_por.yaml' 2026-09-01T00:17:08,071 adding 'lm_eval/tasks/multiblimp/multiblimp_quc.yaml' 2026-09-01T00:17:08,072 adding 'lm_eval/tasks/multiblimp/multiblimp_ron.yaml' 2026-09-01T00:17:08,073 adding 'lm_eval/tasks/multiblimp/multiblimp_rus.yaml' 2026-09-01T00:17:08,074 adding 'lm_eval/tasks/multiblimp/multiblimp_sah.yaml' 2026-09-01T00:17:08,075 adding 'lm_eval/tasks/multiblimp/multiblimp_san.yaml' 2026-09-01T00:17:08,076 adding 'lm_eval/tasks/multiblimp/multiblimp_slk.yaml' 2026-09-01T00:17:08,078 adding 'lm_eval/tasks/multiblimp/multiblimp_slv.yaml' 2026-09-01T00:17:08,079 adding 'lm_eval/tasks/multiblimp/multiblimp_sme.yaml' 2026-09-01T00:17:08,080 adding 'lm_eval/tasks/multiblimp/multiblimp_sms.yaml' 2026-09-01T00:17:08,081 adding 'lm_eval/tasks/multiblimp/multiblimp_spa.yaml' 2026-09-01T00:17:08,082 adding 'lm_eval/tasks/multiblimp/multiblimp_sqi.yaml' 2026-09-01T00:17:08,083 adding 'lm_eval/tasks/multiblimp/multiblimp_swe.yaml' 2026-09-01T00:17:08,084 adding 'lm_eval/tasks/multiblimp/multiblimp_tam.yaml' 2026-09-01T00:17:08,085 adding 'lm_eval/tasks/multiblimp/multiblimp_tpn.yaml' 2026-09-01T00:17:08,087 adding 'lm_eval/tasks/multiblimp/multiblimp_ttc.yaml' 2026-09-01T00:17:08,088 adding 'lm_eval/tasks/multiblimp/multiblimp_tur.yaml' 2026-09-01T00:17:08,089 adding 'lm_eval/tasks/multiblimp/multiblimp_uig.yaml' 2026-09-01T00:17:08,090 adding 'lm_eval/tasks/multiblimp/multiblimp_ukr.yaml' 2026-09-01T00:17:08,091 adding 'lm_eval/tasks/multiblimp/multiblimp_urb.yaml' 2026-09-01T00:17:08,092 adding 'lm_eval/tasks/multiblimp/multiblimp_urd.yaml' 2026-09-01T00:17:08,093 adding 'lm_eval/tasks/multiblimp/multiblimp_uzb.yaml' 2026-09-01T00:17:08,095 adding 'lm_eval/tasks/multiblimp/multiblimp_vep.yaml' 2026-09-01T00:17:08,096 adding 'lm_eval/tasks/multiblimp/multiblimp_wbp.yaml' 2026-09-01T00:17:08,097 adding 'lm_eval/tasks/multiblimp/multiblimp_wol.yaml' 2026-09-01T00:17:08,098 adding 'lm_eval/tasks/multiblimp/multiblimp_xcl.yaml' 2026-09-01T00:17:08,099 adding 'lm_eval/tasks/multiblimp/multiblimp_xnr.yaml' 2026-09-01T00:17:08,100 adding 'lm_eval/tasks/multiblimp/multiblimp_xpg.yaml' 2026-09-01T00:17:08,101 adding 'lm_eval/tasks/multiblimp/multiblimp_yrl.yaml' 2026-09-01T00:17:08,103 adding 'lm_eval/tasks/mutual/README.md' 2026-09-01T00:17:08,104 adding 'lm_eval/tasks/mutual/multual_plus.yaml' 2026-09-01T00:17:08,106 adding 'lm_eval/tasks/mutual/mutual.yaml' 2026-09-01T00:17:08,107 adding 'lm_eval/tasks/mutual/utils.py' 2026-09-01T00:17:08,109 adding 'lm_eval/tasks/nerel-bench/README.md' 2026-09-01T00:17:08,110 adding 'lm_eval/tasks/nerel-bench/_template_yaml' 2026-09-01T00:17:08,111 adding 'lm_eval/tasks/nerel-bench/ru_entity_definition.yaml' 2026-09-01T00:17:08,113 adding 'lm_eval/tasks/nerel-bench/ru_entity_recognition.yaml' 2026-09-01T00:17:08,114 adding 'lm_eval/tasks/nerel-bench/ru_relation_definition.yaml' 2026-09-01T00:17:08,115 adding 'lm_eval/tasks/nerel-bench/ru_relation_extraction.yaml' 2026-09-01T00:17:08,122 adding 'lm_eval/tasks/nerel-bench/utils.py' 2026-09-01T00:17:08,125 adding 'lm_eval/tasks/noreval/README.md' 2026-09-01T00:17:08,205 adding 'lm_eval/tasks/noreval/noreval.jpg' 2026-09-01T00:17:08,211 adding 'lm_eval/tasks/noreval/ask_gec/README.md' 2026-09-01T00:17:08,213 adding 'lm_eval/tasks/noreval/ask_gec/_ask_gec_yaml' 2026-09-01T00:17:08,214 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p0.yaml' 2026-09-01T00:17:08,215 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p1.yaml' 2026-09-01T00:17:08,216 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p2.yaml' 2026-09-01T00:17:08,217 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p3.yaml' 2026-09-01T00:17:08,218 adding 'lm_eval/tasks/noreval/ask_gec/ask_gec_p4.yaml' 2026-09-01T00:17:08,219 adding 'lm_eval/tasks/noreval/ask_gec/errant.py' 2026-09-01T00:17:08,221 adding 'lm_eval/tasks/noreval/ncb/ncb.yaml' 2026-09-01T00:17:08,223 adding 'lm_eval/tasks/noreval/norbelebele/_norbelebele_yaml' 2026-09-01T00:17:08,224 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p0.yaml' 2026-09-01T00:17:08,225 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p1.yaml' 2026-09-01T00:17:08,226 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p2.yaml' 2026-09-01T00:17:08,227 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p3.yaml' 2026-09-01T00:17:08,228 adding 'lm_eval/tasks/noreval/norbelebele/norbelebele_p4.yaml' 2026-09-01T00:17:08,230 adding 'lm_eval/tasks/noreval/norcommonsenseqa/_norcommonsenseqa_yaml' 2026-09-01T00:17:08,231 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p0.yaml' 2026-09-01T00:17:08,233 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p1.yaml' 2026-09-01T00:17:08,234 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p2.yaml' 2026-09-01T00:17:08,235 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p3.yaml' 2026-09-01T00:17:08,236 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nno/norcommonsenseqa_nno_p4.yaml' 2026-09-01T00:17:08,238 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p0.yaml' 2026-09-01T00:17:08,239 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p1.yaml' 2026-09-01T00:17:08,240 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p2.yaml' 2026-09-01T00:17:08,242 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p3.yaml' 2026-09-01T00:17:08,243 adding 'lm_eval/tasks/noreval/norcommonsenseqa/nob/norcommonsenseqa_nob_p4.yaml' 2026-09-01T00:17:08,244 adding 'lm_eval/tasks/noreval/norec/_norec_yaml' 2026-09-01T00:17:08,246 adding 'lm_eval/tasks/noreval/norec/utils.py' 2026-09-01T00:17:08,247 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p0.yaml' 2026-09-01T00:17:08,249 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p1.yaml' 2026-09-01T00:17:08,250 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p2.yaml' 2026-09-01T00:17:08,251 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p3.yaml' 2026-09-01T00:17:08,252 adding 'lm_eval/tasks/noreval/norec/norec_document/norec_document_p4.yaml' 2026-09-01T00:17:08,254 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p0.yaml' 2026-09-01T00:17:08,255 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p1.yaml' 2026-09-01T00:17:08,256 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p2.yaml' 2026-09-01T00:17:08,257 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p3.yaml' 2026-09-01T00:17:08,259 adding 'lm_eval/tasks/noreval/norec/norec_sentence/norec_sentence_p4.yaml' 2026-09-01T00:17:08,260 adding 'lm_eval/tasks/noreval/noridiom/_noridiom_yaml' 2026-09-01T00:17:08,262 adding 'lm_eval/tasks/noreval/noridiom/utils.py' 2026-09-01T00:17:08,263 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p0.yaml' 2026-09-01T00:17:08,264 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p1.yaml' 2026-09-01T00:17:08,266 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p2.yaml' 2026-09-01T00:17:08,267 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p3.yaml' 2026-09-01T00:17:08,268 adding 'lm_eval/tasks/noreval/noridiom/nno/noridiom_nno_p4.yaml' 2026-09-01T00:17:08,270 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p0.yaml' 2026-09-01T00:17:08,271 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p1.yaml' 2026-09-01T00:17:08,272 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p2.yaml' 2026-09-01T00:17:08,273 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p3.yaml' 2026-09-01T00:17:08,274 adding 'lm_eval/tasks/noreval/noridiom/nob/noridiom_nob_p4.yaml' 2026-09-01T00:17:08,276 adding 'lm_eval/tasks/noreval/noropenbookqa/_noropenbookqa_yaml' 2026-09-01T00:17:08,277 adding 'lm_eval/tasks/noreval/noropenbookqa/utils.py' 2026-09-01T00:17:08,279 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p0.yaml' 2026-09-01T00:17:08,280 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p1.yaml' 2026-09-01T00:17:08,281 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p2.yaml' 2026-09-01T00:17:08,282 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p3.yaml' 2026-09-01T00:17:08,283 adding 'lm_eval/tasks/noreval/noropenbookqa/nno/noropenbookqa_nno_p4.yaml' 2026-09-01T00:17:08,285 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p0.yaml' 2026-09-01T00:17:08,286 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p1.yaml' 2026-09-01T00:17:08,287 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p2.yaml' 2026-09-01T00:17:08,289 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p3.yaml' 2026-09-01T00:17:08,290 adding 'lm_eval/tasks/noreval/noropenbookqa/nob/noropenbookqa_nob_p4.yaml' 2026-09-01T00:17:08,291 adding 'lm_eval/tasks/noreval/norquad/_norquad_yaml' 2026-09-01T00:17:08,293 adding 'lm_eval/tasks/noreval/norquad/norquad_p0.yaml' 2026-09-01T00:17:08,294 adding 'lm_eval/tasks/noreval/norquad/norquad_p1.yaml' 2026-09-01T00:17:08,295 adding 'lm_eval/tasks/noreval/norquad/norquad_p2.yaml' 2026-09-01T00:17:08,296 adding 'lm_eval/tasks/noreval/norquad/norquad_p3.yaml' 2026-09-01T00:17:08,297 adding 'lm_eval/tasks/noreval/norquad/norquad_p4.yaml' 2026-09-01T00:17:08,299 adding 'lm_eval/tasks/noreval/norquad/utils.py' 2026-09-01T00:17:08,300 adding 'lm_eval/tasks/noreval/norrewrite-instruct/norrewrite_instruct.yaml' 2026-09-01T00:17:08,302 adding 'lm_eval/tasks/noreval/norsumm/_norsumm_yaml' 2026-09-01T00:17:08,304 adding 'lm_eval/tasks/noreval/norsumm/utils.py' 2026-09-01T00:17:08,306 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p0.yaml' 2026-09-01T00:17:08,307 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p1.yaml' 2026-09-01T00:17:08,308 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p2.yaml' 2026-09-01T00:17:08,309 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p3.yaml' 2026-09-01T00:17:08,310 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p4.yaml' 2026-09-01T00:17:08,312 adding 'lm_eval/tasks/noreval/norsumm/nno/norsumm_nno_p5.yaml' 2026-09-01T00:17:08,313 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p0.yaml' 2026-09-01T00:17:08,315 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p1.yaml' 2026-09-01T00:17:08,316 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p2.yaml' 2026-09-01T00:17:08,317 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p3.yaml' 2026-09-01T00:17:08,318 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p4.yaml' 2026-09-01T00:17:08,319 adding 'lm_eval/tasks/noreval/norsumm/nob/norsumm_nob_p5.yaml' 2026-09-01T00:17:08,321 adding 'lm_eval/tasks/noreval/norsummarize-instruct/norsummarize_instruct.yaml' 2026-09-01T00:17:08,323 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/_nortruthfulqa_gen_yaml' 2026-09-01T00:17:08,325 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/utils.py' 2026-09-01T00:17:08,326 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p0.yaml' 2026-09-01T00:17:08,327 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p1.yaml' 2026-09-01T00:17:08,328 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p2.yaml' 2026-09-01T00:17:08,329 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p3.yaml' 2026-09-01T00:17:08,331 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nno/nortruthfulqa_gen_nno_p4.yaml' 2026-09-01T00:17:08,332 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p0.yaml' 2026-09-01T00:17:08,333 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p1.yaml' 2026-09-01T00:17:08,334 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p2.yaml' 2026-09-01T00:17:08,336 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p3.yaml' 2026-09-01T00:17:08,337 adding 'lm_eval/tasks/noreval/nortruthfulqa/generation/nob/nortruthfulqa_gen_nob_p4.yaml' 2026-09-01T00:17:08,338 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/_nortruthfulqa_mc_yaml' 2026-09-01T00:17:08,340 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p0.yaml' 2026-09-01T00:17:08,341 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p1.yaml' 2026-09-01T00:17:08,342 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p2.yaml' 2026-09-01T00:17:08,343 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p3.yaml' 2026-09-01T00:17:08,344 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/nortruthfulqa_mc_nno_p4.yaml' 2026-09-01T00:17:08,346 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nno/utils.py' 2026-09-01T00:17:08,347 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p0.yaml' 2026-09-01T00:17:08,349 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p1.yaml' 2026-09-01T00:17:08,350 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p2.yaml' 2026-09-01T00:17:08,351 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p3.yaml' 2026-09-01T00:17:08,352 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/nortruthfulqa_mc_nob_p4.yaml' 2026-09-01T00:17:08,353 adding 'lm_eval/tasks/noreval/nortruthfulqa/multiple_choice/nob/utils.py' 2026-09-01T00:17:08,355 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/_nrk_quiz_qa_yaml' 2026-09-01T00:17:08,357 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p0.yaml' 2026-09-01T00:17:08,358 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p1.yaml' 2026-09-01T00:17:08,359 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p2.yaml' 2026-09-01T00:17:08,361 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p3.yaml' 2026-09-01T00:17:08,362 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/nrk_quiz_qa_nno_p4.yaml' 2026-09-01T00:17:08,363 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nno/utils.py' 2026-09-01T00:17:08,365 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p0.yaml' 2026-09-01T00:17:08,367 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p1.yaml' 2026-09-01T00:17:08,368 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p2.yaml' 2026-09-01T00:17:08,369 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p3.yaml' 2026-09-01T00:17:08,370 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/nrk_quiz_qa_nob_p4.yaml' 2026-09-01T00:17:08,372 adding 'lm_eval/tasks/noreval/nrk_quiz_qa/nob/utils.py' 2026-09-01T00:17:08,373 adding 'lm_eval/tasks/noreval/tatoeba/_tatoeba_yaml' 2026-09-01T00:17:08,375 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p0.yaml' 2026-09-01T00:17:08,376 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p1.yaml' 2026-09-01T00:17:08,377 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p2.yaml' 2026-09-01T00:17:08,379 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nno/tatoeba_eng_nno_p3.yaml' 2026-09-01T00:17:08,380 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p0.yaml' 2026-09-01T00:17:08,381 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p1.yaml' 2026-09-01T00:17:08,382 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p2.yaml' 2026-09-01T00:17:08,384 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_eng_nob/tatoeba_eng_nob_p3.yaml' 2026-09-01T00:17:08,385 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p0.yaml' 2026-09-01T00:17:08,386 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p1.yaml' 2026-09-01T00:17:08,387 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p2.yaml' 2026-09-01T00:17:08,388 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nno_eng/tatoeba_nno_eng_p3.yaml' 2026-09-01T00:17:08,390 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p0.yaml' 2026-09-01T00:17:08,391 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p1.yaml' 2026-09-01T00:17:08,392 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p2.yaml' 2026-09-01T00:17:08,393 adding 'lm_eval/tasks/noreval/tatoeba/tatoeba_nob_eng/tatoeba_nob_eng_p3.yaml' 2026-09-01T00:17:08,395 adding 'lm_eval/tasks/noticia/README.md' 2026-09-01T00:17:08,397 adding 'lm_eval/tasks/noticia/noticia.yaml' 2026-09-01T00:17:08,398 adding 'lm_eval/tasks/noticia/utils.py' 2026-09-01T00:17:08,399 adding 'lm_eval/tasks/nq_open/README.md' 2026-09-01T00:17:08,401 adding 'lm_eval/tasks/nq_open/nq_open.yaml' 2026-09-01T00:17:08,404 adding 'lm_eval/tasks/okapi/arc_multilingual/README.md' 2026-09-01T00:17:08,405 adding 'lm_eval/tasks/okapi/arc_multilingual/_arc_yaml' 2026-09-01T00:17:08,406 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml' 2026-09-01T00:17:08,407 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml' 2026-09-01T00:17:08,408 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml' 2026-09-01T00:17:08,409 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml' 2026-09-01T00:17:08,411 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml' 2026-09-01T00:17:08,412 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml' 2026-09-01T00:17:08,413 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml' 2026-09-01T00:17:08,414 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml' 2026-09-01T00:17:08,416 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml' 2026-09-01T00:17:08,417 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml' 2026-09-01T00:17:08,418 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml' 2026-09-01T00:17:08,419 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml' 2026-09-01T00:17:08,420 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml' 2026-09-01T00:17:08,421 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml' 2026-09-01T00:17:08,423 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml' 2026-09-01T00:17:08,424 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml' 2026-09-01T00:17:08,425 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml' 2026-09-01T00:17:08,426 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml' 2026-09-01T00:17:08,427 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml' 2026-09-01T00:17:08,429 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml' 2026-09-01T00:17:08,430 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml' 2026-09-01T00:17:08,431 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml' 2026-09-01T00:17:08,432 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml' 2026-09-01T00:17:08,433 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml' 2026-09-01T00:17:08,434 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml' 2026-09-01T00:17:08,435 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml' 2026-09-01T00:17:08,436 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml' 2026-09-01T00:17:08,437 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml' 2026-09-01T00:17:08,439 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml' 2026-09-01T00:17:08,440 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml' 2026-09-01T00:17:08,441 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml' 2026-09-01T00:17:08,442 adding 'lm_eval/tasks/okapi/arc_multilingual/utils.py' 2026-09-01T00:17:08,444 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/README.md' 2026-09-01T00:17:08,445 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml' 2026-09-01T00:17:08,447 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml' 2026-09-01T00:17:08,448 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml' 2026-09-01T00:17:08,449 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml' 2026-09-01T00:17:08,450 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml' 2026-09-01T00:17:08,451 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml' 2026-09-01T00:17:08,452 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml' 2026-09-01T00:17:08,453 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml' 2026-09-01T00:17:08,454 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml' 2026-09-01T00:17:08,456 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml' 2026-09-01T00:17:08,457 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml' 2026-09-01T00:17:08,458 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml' 2026-09-01T00:17:08,459 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml' 2026-09-01T00:17:08,460 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml' 2026-09-01T00:17:08,461 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml' 2026-09-01T00:17:08,462 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml' 2026-09-01T00:17:08,464 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml' 2026-09-01T00:17:08,465 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml' 2026-09-01T00:17:08,466 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml' 2026-09-01T00:17:08,467 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml' 2026-09-01T00:17:08,468 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml' 2026-09-01T00:17:08,470 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml' 2026-09-01T00:17:08,471 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml' 2026-09-01T00:17:08,472 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml' 2026-09-01T00:17:08,473 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml' 2026-09-01T00:17:08,474 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml' 2026-09-01T00:17:08,475 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml' 2026-09-01T00:17:08,477 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml' 2026-09-01T00:17:08,478 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml' 2026-09-01T00:17:08,479 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml' 2026-09-01T00:17:08,480 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml' 2026-09-01T00:17:08,481 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/utils.py' 2026-09-01T00:17:08,484 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml' 2026-09-01T00:17:08,485 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py' 2026-09-01T00:17:08,486 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml' 2026-09-01T00:17:08,487 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml' 2026-09-01T00:17:08,488 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml' 2026-09-01T00:17:08,489 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml' 2026-09-01T00:17:08,490 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml' 2026-09-01T00:17:08,491 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml' 2026-09-01T00:17:08,492 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml' 2026-09-01T00:17:08,493 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml' 2026-09-01T00:17:08,495 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml' 2026-09-01T00:17:08,496 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml' 2026-09-01T00:17:08,497 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml' 2026-09-01T00:17:08,498 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml' 2026-09-01T00:17:08,499 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml' 2026-09-01T00:17:08,500 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml' 2026-09-01T00:17:08,502 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml' 2026-09-01T00:17:08,503 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml' 2026-09-01T00:17:08,504 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml' 2026-09-01T00:17:08,505 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml' 2026-09-01T00:17:08,506 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml' 2026-09-01T00:17:08,507 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml' 2026-09-01T00:17:08,508 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml' 2026-09-01T00:17:08,509 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml' 2026-09-01T00:17:08,511 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml' 2026-09-01T00:17:08,512 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml' 2026-09-01T00:17:08,513 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml' 2026-09-01T00:17:08,514 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml' 2026-09-01T00:17:08,515 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml' 2026-09-01T00:17:08,516 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml' 2026-09-01T00:17:08,517 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml' 2026-09-01T00:17:08,519 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml' 2026-09-01T00:17:08,520 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml' 2026-09-01T00:17:08,521 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml' 2026-09-01T00:17:08,522 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml' 2026-09-01T00:17:08,523 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml' 2026-09-01T00:17:08,526 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/README.md' 2026-09-01T00:17:08,528 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml' 2026-09-01T00:17:08,529 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml' 2026-09-01T00:17:08,530 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml' 2026-09-01T00:17:08,531 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml' 2026-09-01T00:17:08,532 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml' 2026-09-01T00:17:08,534 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml' 2026-09-01T00:17:08,535 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml' 2026-09-01T00:17:08,536 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml' 2026-09-01T00:17:08,537 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml' 2026-09-01T00:17:08,538 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml' 2026-09-01T00:17:08,539 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml' 2026-09-01T00:17:08,541 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml' 2026-09-01T00:17:08,542 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml' 2026-09-01T00:17:08,543 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml' 2026-09-01T00:17:08,544 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml' 2026-09-01T00:17:08,545 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml' 2026-09-01T00:17:08,546 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml' 2026-09-01T00:17:08,547 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml' 2026-09-01T00:17:08,548 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml' 2026-09-01T00:17:08,550 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml' 2026-09-01T00:17:08,551 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml' 2026-09-01T00:17:08,552 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml' 2026-09-01T00:17:08,553 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml' 2026-09-01T00:17:08,554 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml' 2026-09-01T00:17:08,555 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml' 2026-09-01T00:17:08,556 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml' 2026-09-01T00:17:08,557 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml' 2026-09-01T00:17:08,559 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml' 2026-09-01T00:17:08,560 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml' 2026-09-01T00:17:08,561 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml' 2026-09-01T00:17:08,562 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml' 2026-09-01T00:17:08,563 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml' 2026-09-01T00:17:08,564 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml' 2026-09-01T00:17:08,566 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml' 2026-09-01T00:17:08,567 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml' 2026-09-01T00:17:08,568 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml' 2026-09-01T00:17:08,569 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml' 2026-09-01T00:17:08,570 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml' 2026-09-01T00:17:08,572 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml' 2026-09-01T00:17:08,573 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml' 2026-09-01T00:17:08,574 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml' 2026-09-01T00:17:08,575 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml' 2026-09-01T00:17:08,576 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml' 2026-09-01T00:17:08,577 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml' 2026-09-01T00:17:08,579 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml' 2026-09-01T00:17:08,580 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml' 2026-09-01T00:17:08,581 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml' 2026-09-01T00:17:08,582 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml' 2026-09-01T00:17:08,583 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml' 2026-09-01T00:17:08,585 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml' 2026-09-01T00:17:08,586 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml' 2026-09-01T00:17:08,587 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml' 2026-09-01T00:17:08,588 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml' 2026-09-01T00:17:08,589 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml' 2026-09-01T00:17:08,590 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml' 2026-09-01T00:17:08,591 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml' 2026-09-01T00:17:08,592 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml' 2026-09-01T00:17:08,593 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml' 2026-09-01T00:17:08,595 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml' 2026-09-01T00:17:08,596 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml' 2026-09-01T00:17:08,597 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml' 2026-09-01T00:17:08,598 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml' 2026-09-01T00:17:08,599 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml' 2026-09-01T00:17:08,601 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml' 2026-09-01T00:17:08,602 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py' 2026-09-01T00:17:08,604 adding 'lm_eval/tasks/olaph/README.md' 2026-09-01T00:17:08,605 adding 'lm_eval/tasks/olaph/olaph.yaml' 2026-09-01T00:17:08,606 adding 'lm_eval/tasks/olaph/olaph_perplexity.yaml' 2026-09-01T00:17:08,608 adding 'lm_eval/tasks/olaph/utils.py' 2026-09-01T00:17:08,609 adding 'lm_eval/tasks/olaph/utils_perplexity.py' 2026-09-01T00:17:08,611 adding 'lm_eval/tasks/openai-mmmlu/README.md' 2026-09-01T00:17:08,612 adding 'lm_eval/tasks/openai-mmmlu/_generate_configs.py' 2026-09-01T00:17:08,613 adding 'lm_eval/tasks/openai-mmmlu/languages.json' 2026-09-01T00:17:08,615 adding 'lm_eval/tasks/openai-mmmlu/subjects.json' 2026-09-01T00:17:08,671 adding 'lm_eval/tasks/openai-mmmlu/default/_default_template_yaml' 2026-09-01T00:17:08,672 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu.yaml' 2026-09-01T00:17:08,673 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy.yaml' 2026-09-01T00:17:08,674 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_humanities.yaml' 2026-09-01T00:17:08,675 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_other.yaml' 2026-09-01T00:17:08,677 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_social_sciences.yaml' 2026-09-01T00:17:08,678 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ar_xy_stem.yaml' 2026-09-01T00:17:08,679 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd.yaml' 2026-09-01T00:17:08,680 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_humanities.yaml' 2026-09-01T00:17:08,682 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_other.yaml' 2026-09-01T00:17:08,683 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_social_sciences.yaml' 2026-09-01T00:17:08,684 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_bn_bd_stem.yaml' 2026-09-01T00:17:08,685 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de.yaml' 2026-09-01T00:17:08,686 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_humanities.yaml' 2026-09-01T00:17:08,688 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_other.yaml' 2026-09-01T00:17:08,689 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_social_sciences.yaml' 2026-09-01T00:17:08,690 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_de_de_stem.yaml' 2026-09-01T00:17:08,691 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la.yaml' 2026-09-01T00:17:08,692 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_humanities.yaml' 2026-09-01T00:17:08,693 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_other.yaml' 2026-09-01T00:17:08,695 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_social_sciences.yaml' 2026-09-01T00:17:08,696 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_es_la_stem.yaml' 2026-09-01T00:17:08,697 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr.yaml' 2026-09-01T00:17:08,698 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_humanities.yaml' 2026-09-01T00:17:08,699 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_other.yaml' 2026-09-01T00:17:08,700 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_social_sciences.yaml' 2026-09-01T00:17:08,701 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_fr_fr_stem.yaml' 2026-09-01T00:17:08,702 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in.yaml' 2026-09-01T00:17:08,703 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_humanities.yaml' 2026-09-01T00:17:08,705 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_other.yaml' 2026-09-01T00:17:08,706 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_social_sciences.yaml' 2026-09-01T00:17:08,707 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_hi_in_stem.yaml' 2026-09-01T00:17:08,708 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id.yaml' 2026-09-01T00:17:08,709 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_humanities.yaml' 2026-09-01T00:17:08,711 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_other.yaml' 2026-09-01T00:17:08,712 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_social_sciences.yaml' 2026-09-01T00:17:08,713 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_id_id_stem.yaml' 2026-09-01T00:17:08,714 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it.yaml' 2026-09-01T00:17:08,715 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_humanities.yaml' 2026-09-01T00:17:08,716 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_other.yaml' 2026-09-01T00:17:08,717 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_social_sciences.yaml' 2026-09-01T00:17:08,719 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_it_it_stem.yaml' 2026-09-01T00:17:08,720 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp.yaml' 2026-09-01T00:17:08,721 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_humanities.yaml' 2026-09-01T00:17:08,722 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_other.yaml' 2026-09-01T00:17:08,723 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_social_sciences.yaml' 2026-09-01T00:17:08,724 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ja_jp_stem.yaml' 2026-09-01T00:17:08,726 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr.yaml' 2026-09-01T00:17:08,727 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_humanities.yaml' 2026-09-01T00:17:08,728 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_other.yaml' 2026-09-01T00:17:08,729 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_social_sciences.yaml' 2026-09-01T00:17:08,730 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_ko_kr_stem.yaml' 2026-09-01T00:17:08,732 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br.yaml' 2026-09-01T00:17:08,733 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_humanities.yaml' 2026-09-01T00:17:08,734 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_other.yaml' 2026-09-01T00:17:08,735 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_social_sciences.yaml' 2026-09-01T00:17:08,736 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_pt_br_stem.yaml' 2026-09-01T00:17:08,738 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke.yaml' 2026-09-01T00:17:08,739 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_humanities.yaml' 2026-09-01T00:17:08,740 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_other.yaml' 2026-09-01T00:17:08,741 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_social_sciences.yaml' 2026-09-01T00:17:08,742 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_sw_ke_stem.yaml' 2026-09-01T00:17:08,744 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng.yaml' 2026-09-01T00:17:08,745 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_humanities.yaml' 2026-09-01T00:17:08,746 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_other.yaml' 2026-09-01T00:17:08,747 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_social_sciences.yaml' 2026-09-01T00:17:08,748 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_yo_ng_stem.yaml' 2026-09-01T00:17:08,749 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn.yaml' 2026-09-01T00:17:08,750 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_humanities.yaml' 2026-09-01T00:17:08,751 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_other.yaml' 2026-09-01T00:17:08,753 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_social_sciences.yaml' 2026-09-01T00:17:08,754 adding 'lm_eval/tasks/openai-mmmlu/default/_mmmlu_zh_cn_stem.yaml' 2026-09-01T00:17:08,755 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_abstract_algebra.yaml' 2026-09-01T00:17:08,756 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_anatomy.yaml' 2026-09-01T00:17:08,757 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_astronomy.yaml' 2026-09-01T00:17:08,759 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_business_ethics.yaml' 2026-09-01T00:17:08,760 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_clinical_knowledge.yaml' 2026-09-01T00:17:08,761 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_biology.yaml' 2026-09-01T00:17:08,762 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_chemistry.yaml' 2026-09-01T00:17:08,763 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_computer_science.yaml' 2026-09-01T00:17:08,764 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_mathematics.yaml' 2026-09-01T00:17:08,766 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_medicine.yaml' 2026-09-01T00:17:08,767 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_college_physics.yaml' 2026-09-01T00:17:08,768 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_computer_security.yaml' 2026-09-01T00:17:08,769 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_conceptual_physics.yaml' 2026-09-01T00:17:08,770 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_econometrics.yaml' 2026-09-01T00:17:08,771 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_electrical_engineering.yaml' 2026-09-01T00:17:08,773 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_elementary_mathematics.yaml' 2026-09-01T00:17:08,774 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_formal_logic.yaml' 2026-09-01T00:17:08,775 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_global_facts.yaml' 2026-09-01T00:17:08,776 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_biology.yaml' 2026-09-01T00:17:08,777 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_chemistry.yaml' 2026-09-01T00:17:08,779 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_computer_science.yaml' 2026-09-01T00:17:08,780 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_european_history.yaml' 2026-09-01T00:17:08,781 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_geography.yaml' 2026-09-01T00:17:08,782 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_government_and_politics.yaml' 2026-09-01T00:17:08,784 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_macroeconomics.yaml' 2026-09-01T00:17:08,785 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_mathematics.yaml' 2026-09-01T00:17:08,786 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_microeconomics.yaml' 2026-09-01T00:17:08,787 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_physics.yaml' 2026-09-01T00:17:08,788 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_psychology.yaml' 2026-09-01T00:17:08,790 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_statistics.yaml' 2026-09-01T00:17:08,791 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_us_history.yaml' 2026-09-01T00:17:08,792 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_high_school_world_history.yaml' 2026-09-01T00:17:08,793 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_aging.yaml' 2026-09-01T00:17:08,794 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_human_sexuality.yaml' 2026-09-01T00:17:08,795 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_international_law.yaml' 2026-09-01T00:17:08,797 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_jurisprudence.yaml' 2026-09-01T00:17:08,798 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_logical_fallacies.yaml' 2026-09-01T00:17:08,799 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_machine_learning.yaml' 2026-09-01T00:17:08,800 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_management.yaml' 2026-09-01T00:17:08,801 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_marketing.yaml' 2026-09-01T00:17:08,802 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_medical_genetics.yaml' 2026-09-01T00:17:08,803 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_miscellaneous.yaml' 2026-09-01T00:17:08,805 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_disputes.yaml' 2026-09-01T00:17:08,806 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_moral_scenarios.yaml' 2026-09-01T00:17:08,807 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_nutrition.yaml' 2026-09-01T00:17:08,808 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_philosophy.yaml' 2026-09-01T00:17:08,809 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_prehistory.yaml' 2026-09-01T00:17:08,810 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_accounting.yaml' 2026-09-01T00:17:08,812 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_law.yaml' 2026-09-01T00:17:08,813 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_medicine.yaml' 2026-09-01T00:17:08,814 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_professional_psychology.yaml' 2026-09-01T00:17:08,816 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_public_relations.yaml' 2026-09-01T00:17:08,817 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_security_studies.yaml' 2026-09-01T00:17:08,818 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_sociology.yaml' 2026-09-01T00:17:08,819 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_us_foreign_policy.yaml' 2026-09-01T00:17:08,820 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_virology.yaml' 2026-09-01T00:17:08,821 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ar_xy_world_religions.yaml' 2026-09-01T00:17:08,823 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_abstract_algebra.yaml' 2026-09-01T00:17:08,824 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_anatomy.yaml' 2026-09-01T00:17:08,825 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_astronomy.yaml' 2026-09-01T00:17:08,826 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_business_ethics.yaml' 2026-09-01T00:17:08,828 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_clinical_knowledge.yaml' 2026-09-01T00:17:08,829 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_biology.yaml' 2026-09-01T00:17:08,830 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_chemistry.yaml' 2026-09-01T00:17:08,831 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_computer_science.yaml' 2026-09-01T00:17:08,833 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_mathematics.yaml' 2026-09-01T00:17:08,834 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_medicine.yaml' 2026-09-01T00:17:08,835 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_college_physics.yaml' 2026-09-01T00:17:08,836 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_computer_security.yaml' 2026-09-01T00:17:08,837 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_conceptual_physics.yaml' 2026-09-01T00:17:08,839 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_econometrics.yaml' 2026-09-01T00:17:08,840 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_electrical_engineering.yaml' 2026-09-01T00:17:08,841 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_elementary_mathematics.yaml' 2026-09-01T00:17:08,842 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_formal_logic.yaml' 2026-09-01T00:17:08,843 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_global_facts.yaml' 2026-09-01T00:17:08,844 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_biology.yaml' 2026-09-01T00:17:08,845 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_chemistry.yaml' 2026-09-01T00:17:08,846 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_computer_science.yaml' 2026-09-01T00:17:08,847 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_european_history.yaml' 2026-09-01T00:17:08,848 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_geography.yaml' 2026-09-01T00:17:08,850 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_government_and_politics.yaml' 2026-09-01T00:17:08,851 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_macroeconomics.yaml' 2026-09-01T00:17:08,852 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_mathematics.yaml' 2026-09-01T00:17:08,853 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_microeconomics.yaml' 2026-09-01T00:17:08,854 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_physics.yaml' 2026-09-01T00:17:08,856 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_psychology.yaml' 2026-09-01T00:17:08,857 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_statistics.yaml' 2026-09-01T00:17:08,858 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_us_history.yaml' 2026-09-01T00:17:08,859 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_high_school_world_history.yaml' 2026-09-01T00:17:08,861 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_aging.yaml' 2026-09-01T00:17:08,862 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_human_sexuality.yaml' 2026-09-01T00:17:08,863 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_international_law.yaml' 2026-09-01T00:17:08,864 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_jurisprudence.yaml' 2026-09-01T00:17:08,865 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_logical_fallacies.yaml' 2026-09-01T00:17:08,866 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_machine_learning.yaml' 2026-09-01T00:17:08,868 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_management.yaml' 2026-09-01T00:17:08,869 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_marketing.yaml' 2026-09-01T00:17:08,870 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_medical_genetics.yaml' 2026-09-01T00:17:08,871 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_miscellaneous.yaml' 2026-09-01T00:17:08,872 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_disputes.yaml' 2026-09-01T00:17:08,874 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_moral_scenarios.yaml' 2026-09-01T00:17:08,875 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_nutrition.yaml' 2026-09-01T00:17:08,876 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_philosophy.yaml' 2026-09-01T00:17:08,877 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_prehistory.yaml' 2026-09-01T00:17:08,879 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_accounting.yaml' 2026-09-01T00:17:08,880 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_law.yaml' 2026-09-01T00:17:08,881 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_medicine.yaml' 2026-09-01T00:17:08,882 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_professional_psychology.yaml' 2026-09-01T00:17:08,884 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_public_relations.yaml' 2026-09-01T00:17:08,885 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_security_studies.yaml' 2026-09-01T00:17:08,886 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_sociology.yaml' 2026-09-01T00:17:08,887 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_us_foreign_policy.yaml' 2026-09-01T00:17:08,888 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_virology.yaml' 2026-09-01T00:17:08,889 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_bn_bd_world_religions.yaml' 2026-09-01T00:17:08,890 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_abstract_algebra.yaml' 2026-09-01T00:17:08,892 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_anatomy.yaml' 2026-09-01T00:17:08,893 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_astronomy.yaml' 2026-09-01T00:17:08,894 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_business_ethics.yaml' 2026-09-01T00:17:08,895 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_clinical_knowledge.yaml' 2026-09-01T00:17:08,897 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_biology.yaml' 2026-09-01T00:17:08,898 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_chemistry.yaml' 2026-09-01T00:17:08,899 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_computer_science.yaml' 2026-09-01T00:17:08,900 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_mathematics.yaml' 2026-09-01T00:17:08,902 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_medicine.yaml' 2026-09-01T00:17:08,903 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_college_physics.yaml' 2026-09-01T00:17:08,904 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_computer_security.yaml' 2026-09-01T00:17:08,905 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_conceptual_physics.yaml' 2026-09-01T00:17:08,906 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_econometrics.yaml' 2026-09-01T00:17:08,907 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_electrical_engineering.yaml' 2026-09-01T00:17:08,908 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_elementary_mathematics.yaml' 2026-09-01T00:17:08,910 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_formal_logic.yaml' 2026-09-01T00:17:08,911 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_global_facts.yaml' 2026-09-01T00:17:08,912 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_biology.yaml' 2026-09-01T00:17:08,913 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_chemistry.yaml' 2026-09-01T00:17:08,914 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_computer_science.yaml' 2026-09-01T00:17:08,916 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_european_history.yaml' 2026-09-01T00:17:08,917 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_geography.yaml' 2026-09-01T00:17:08,918 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_government_and_politics.yaml' 2026-09-01T00:17:08,919 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_macroeconomics.yaml' 2026-09-01T00:17:08,920 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_mathematics.yaml' 2026-09-01T00:17:08,922 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_microeconomics.yaml' 2026-09-01T00:17:08,923 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_physics.yaml' 2026-09-01T00:17:08,924 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_psychology.yaml' 2026-09-01T00:17:08,925 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_statistics.yaml' 2026-09-01T00:17:08,927 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_us_history.yaml' 2026-09-01T00:17:08,928 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_high_school_world_history.yaml' 2026-09-01T00:17:08,929 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_aging.yaml' 2026-09-01T00:17:08,930 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_human_sexuality.yaml' 2026-09-01T00:17:08,931 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_international_law.yaml' 2026-09-01T00:17:08,932 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_jurisprudence.yaml' 2026-09-01T00:17:08,934 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_logical_fallacies.yaml' 2026-09-01T00:17:08,935 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_machine_learning.yaml' 2026-09-01T00:17:08,936 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_management.yaml' 2026-09-01T00:17:08,937 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_marketing.yaml' 2026-09-01T00:17:08,938 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_medical_genetics.yaml' 2026-09-01T00:17:08,939 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_miscellaneous.yaml' 2026-09-01T00:17:08,940 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_disputes.yaml' 2026-09-01T00:17:08,941 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_moral_scenarios.yaml' 2026-09-01T00:17:08,942 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_nutrition.yaml' 2026-09-01T00:17:08,944 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_philosophy.yaml' 2026-09-01T00:17:08,945 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_prehistory.yaml' 2026-09-01T00:17:08,946 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_accounting.yaml' 2026-09-01T00:17:08,947 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_law.yaml' 2026-09-01T00:17:08,948 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_medicine.yaml' 2026-09-01T00:17:08,950 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_professional_psychology.yaml' 2026-09-01T00:17:08,951 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_public_relations.yaml' 2026-09-01T00:17:08,952 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_security_studies.yaml' 2026-09-01T00:17:08,953 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_sociology.yaml' 2026-09-01T00:17:08,954 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_us_foreign_policy.yaml' 2026-09-01T00:17:08,955 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_virology.yaml' 2026-09-01T00:17:08,957 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_de_de_world_religions.yaml' 2026-09-01T00:17:08,958 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_abstract_algebra.yaml' 2026-09-01T00:17:08,959 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_anatomy.yaml' 2026-09-01T00:17:08,960 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_astronomy.yaml' 2026-09-01T00:17:08,961 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_business_ethics.yaml' 2026-09-01T00:17:08,963 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_clinical_knowledge.yaml' 2026-09-01T00:17:08,964 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_biology.yaml' 2026-09-01T00:17:08,965 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_chemistry.yaml' 2026-09-01T00:17:08,966 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_computer_science.yaml' 2026-09-01T00:17:08,967 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_mathematics.yaml' 2026-09-01T00:17:08,969 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_medicine.yaml' 2026-09-01T00:17:08,970 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_college_physics.yaml' 2026-09-01T00:17:08,971 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_computer_security.yaml' 2026-09-01T00:17:08,972 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_conceptual_physics.yaml' 2026-09-01T00:17:08,973 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_econometrics.yaml' 2026-09-01T00:17:08,975 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_electrical_engineering.yaml' 2026-09-01T00:17:08,976 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_elementary_mathematics.yaml' 2026-09-01T00:17:08,977 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_formal_logic.yaml' 2026-09-01T00:17:08,978 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_global_facts.yaml' 2026-09-01T00:17:08,979 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_biology.yaml' 2026-09-01T00:17:08,980 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_chemistry.yaml' 2026-09-01T00:17:08,981 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_computer_science.yaml' 2026-09-01T00:17:08,982 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_european_history.yaml' 2026-09-01T00:17:08,983 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_geography.yaml' 2026-09-01T00:17:08,985 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_government_and_politics.yaml' 2026-09-01T00:17:08,986 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_macroeconomics.yaml' 2026-09-01T00:17:08,987 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_mathematics.yaml' 2026-09-01T00:17:08,988 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_microeconomics.yaml' 2026-09-01T00:17:08,989 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_physics.yaml' 2026-09-01T00:17:08,990 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_psychology.yaml' 2026-09-01T00:17:08,992 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_statistics.yaml' 2026-09-01T00:17:08,993 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_us_history.yaml' 2026-09-01T00:17:08,994 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_high_school_world_history.yaml' 2026-09-01T00:17:08,995 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_aging.yaml' 2026-09-01T00:17:08,996 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_human_sexuality.yaml' 2026-09-01T00:17:08,997 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_international_law.yaml' 2026-09-01T00:17:08,999 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_jurisprudence.yaml' 2026-09-01T00:17:09,000 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_logical_fallacies.yaml' 2026-09-01T00:17:09,001 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_machine_learning.yaml' 2026-09-01T00:17:09,002 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_management.yaml' 2026-09-01T00:17:09,003 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_marketing.yaml' 2026-09-01T00:17:09,005 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_medical_genetics.yaml' 2026-09-01T00:17:09,006 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_miscellaneous.yaml' 2026-09-01T00:17:09,007 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_disputes.yaml' 2026-09-01T00:17:09,008 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_moral_scenarios.yaml' 2026-09-01T00:17:09,009 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_nutrition.yaml' 2026-09-01T00:17:09,010 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_philosophy.yaml' 2026-09-01T00:17:09,012 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_prehistory.yaml' 2026-09-01T00:17:09,013 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_accounting.yaml' 2026-09-01T00:17:09,014 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_law.yaml' 2026-09-01T00:17:09,015 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_medicine.yaml' 2026-09-01T00:17:09,017 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_professional_psychology.yaml' 2026-09-01T00:17:09,018 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_public_relations.yaml' 2026-09-01T00:17:09,019 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_security_studies.yaml' 2026-09-01T00:17:09,021 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_sociology.yaml' 2026-09-01T00:17:09,022 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_us_foreign_policy.yaml' 2026-09-01T00:17:09,023 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_virology.yaml' 2026-09-01T00:17:09,024 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_es_la_world_religions.yaml' 2026-09-01T00:17:09,025 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_abstract_algebra.yaml' 2026-09-01T00:17:09,026 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_anatomy.yaml' 2026-09-01T00:17:09,027 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_astronomy.yaml' 2026-09-01T00:17:09,029 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_business_ethics.yaml' 2026-09-01T00:17:09,030 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_clinical_knowledge.yaml' 2026-09-01T00:17:09,031 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_biology.yaml' 2026-09-01T00:17:09,032 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_chemistry.yaml' 2026-09-01T00:17:09,033 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_computer_science.yaml' 2026-09-01T00:17:09,034 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_mathematics.yaml' 2026-09-01T00:17:09,036 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_medicine.yaml' 2026-09-01T00:17:09,037 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_college_physics.yaml' 2026-09-01T00:17:09,038 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_computer_security.yaml' 2026-09-01T00:17:09,039 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_conceptual_physics.yaml' 2026-09-01T00:17:09,040 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_econometrics.yaml' 2026-09-01T00:17:09,041 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_electrical_engineering.yaml' 2026-09-01T00:17:09,043 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_elementary_mathematics.yaml' 2026-09-01T00:17:09,044 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_formal_logic.yaml' 2026-09-01T00:17:09,045 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_global_facts.yaml' 2026-09-01T00:17:09,046 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_biology.yaml' 2026-09-01T00:17:09,047 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_chemistry.yaml' 2026-09-01T00:17:09,048 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_computer_science.yaml' 2026-09-01T00:17:09,050 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_european_history.yaml' 2026-09-01T00:17:09,051 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_geography.yaml' 2026-09-01T00:17:09,052 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,053 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,054 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_mathematics.yaml' 2026-09-01T00:17:09,056 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_microeconomics.yaml' 2026-09-01T00:17:09,057 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_physics.yaml' 2026-09-01T00:17:09,058 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_psychology.yaml' 2026-09-01T00:17:09,059 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_statistics.yaml' 2026-09-01T00:17:09,060 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_us_history.yaml' 2026-09-01T00:17:09,061 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_high_school_world_history.yaml' 2026-09-01T00:17:09,063 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_aging.yaml' 2026-09-01T00:17:09,064 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_human_sexuality.yaml' 2026-09-01T00:17:09,065 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_international_law.yaml' 2026-09-01T00:17:09,067 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_jurisprudence.yaml' 2026-09-01T00:17:09,068 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_logical_fallacies.yaml' 2026-09-01T00:17:09,069 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_machine_learning.yaml' 2026-09-01T00:17:09,070 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_management.yaml' 2026-09-01T00:17:09,071 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_marketing.yaml' 2026-09-01T00:17:09,072 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_medical_genetics.yaml' 2026-09-01T00:17:09,073 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_miscellaneous.yaml' 2026-09-01T00:17:09,074 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_disputes.yaml' 2026-09-01T00:17:09,076 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_moral_scenarios.yaml' 2026-09-01T00:17:09,077 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_nutrition.yaml' 2026-09-01T00:17:09,078 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_philosophy.yaml' 2026-09-01T00:17:09,079 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_prehistory.yaml' 2026-09-01T00:17:09,080 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_accounting.yaml' 2026-09-01T00:17:09,082 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_law.yaml' 2026-09-01T00:17:09,083 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_medicine.yaml' 2026-09-01T00:17:09,084 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_professional_psychology.yaml' 2026-09-01T00:17:09,085 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_public_relations.yaml' 2026-09-01T00:17:09,086 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_security_studies.yaml' 2026-09-01T00:17:09,087 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_sociology.yaml' 2026-09-01T00:17:09,088 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_us_foreign_policy.yaml' 2026-09-01T00:17:09,090 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_virology.yaml' 2026-09-01T00:17:09,091 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_fr_fr_world_religions.yaml' 2026-09-01T00:17:09,092 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_abstract_algebra.yaml' 2026-09-01T00:17:09,093 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_anatomy.yaml' 2026-09-01T00:17:09,094 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_astronomy.yaml' 2026-09-01T00:17:09,096 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_business_ethics.yaml' 2026-09-01T00:17:09,097 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_clinical_knowledge.yaml' 2026-09-01T00:17:09,098 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_biology.yaml' 2026-09-01T00:17:09,099 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_chemistry.yaml' 2026-09-01T00:17:09,100 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_computer_science.yaml' 2026-09-01T00:17:09,102 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_mathematics.yaml' 2026-09-01T00:17:09,103 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_medicine.yaml' 2026-09-01T00:17:09,104 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_college_physics.yaml' 2026-09-01T00:17:09,105 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_computer_security.yaml' 2026-09-01T00:17:09,107 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_conceptual_physics.yaml' 2026-09-01T00:17:09,108 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_econometrics.yaml' 2026-09-01T00:17:09,109 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_electrical_engineering.yaml' 2026-09-01T00:17:09,110 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_elementary_mathematics.yaml' 2026-09-01T00:17:09,111 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_formal_logic.yaml' 2026-09-01T00:17:09,113 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_global_facts.yaml' 2026-09-01T00:17:09,114 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_biology.yaml' 2026-09-01T00:17:09,115 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_chemistry.yaml' 2026-09-01T00:17:09,116 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_computer_science.yaml' 2026-09-01T00:17:09,117 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_european_history.yaml' 2026-09-01T00:17:09,118 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_geography.yaml' 2026-09-01T00:17:09,119 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,120 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,121 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_mathematics.yaml' 2026-09-01T00:17:09,122 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_microeconomics.yaml' 2026-09-01T00:17:09,124 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_physics.yaml' 2026-09-01T00:17:09,125 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_psychology.yaml' 2026-09-01T00:17:09,126 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_statistics.yaml' 2026-09-01T00:17:09,127 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_us_history.yaml' 2026-09-01T00:17:09,128 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_high_school_world_history.yaml' 2026-09-01T00:17:09,129 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_aging.yaml' 2026-09-01T00:17:09,131 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_human_sexuality.yaml' 2026-09-01T00:17:09,132 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_international_law.yaml' 2026-09-01T00:17:09,133 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_jurisprudence.yaml' 2026-09-01T00:17:09,134 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_logical_fallacies.yaml' 2026-09-01T00:17:09,135 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_machine_learning.yaml' 2026-09-01T00:17:09,136 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_management.yaml' 2026-09-01T00:17:09,137 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_marketing.yaml' 2026-09-01T00:17:09,139 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_medical_genetics.yaml' 2026-09-01T00:17:09,140 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_miscellaneous.yaml' 2026-09-01T00:17:09,141 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_disputes.yaml' 2026-09-01T00:17:09,142 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_moral_scenarios.yaml' 2026-09-01T00:17:09,143 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_nutrition.yaml' 2026-09-01T00:17:09,145 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_philosophy.yaml' 2026-09-01T00:17:09,146 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_prehistory.yaml' 2026-09-01T00:17:09,147 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_accounting.yaml' 2026-09-01T00:17:09,148 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_law.yaml' 2026-09-01T00:17:09,149 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_medicine.yaml' 2026-09-01T00:17:09,150 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_professional_psychology.yaml' 2026-09-01T00:17:09,152 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_public_relations.yaml' 2026-09-01T00:17:09,153 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_security_studies.yaml' 2026-09-01T00:17:09,154 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_sociology.yaml' 2026-09-01T00:17:09,156 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_us_foreign_policy.yaml' 2026-09-01T00:17:09,157 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_virology.yaml' 2026-09-01T00:17:09,158 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_hi_in_world_religions.yaml' 2026-09-01T00:17:09,159 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_abstract_algebra.yaml' 2026-09-01T00:17:09,160 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_anatomy.yaml' 2026-09-01T00:17:09,161 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_astronomy.yaml' 2026-09-01T00:17:09,162 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_business_ethics.yaml' 2026-09-01T00:17:09,164 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_clinical_knowledge.yaml' 2026-09-01T00:17:09,165 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_biology.yaml' 2026-09-01T00:17:09,166 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_chemistry.yaml' 2026-09-01T00:17:09,167 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_computer_science.yaml' 2026-09-01T00:17:09,168 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_mathematics.yaml' 2026-09-01T00:17:09,169 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_medicine.yaml' 2026-09-01T00:17:09,170 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_college_physics.yaml' 2026-09-01T00:17:09,172 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_computer_security.yaml' 2026-09-01T00:17:09,173 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_conceptual_physics.yaml' 2026-09-01T00:17:09,174 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_econometrics.yaml' 2026-09-01T00:17:09,175 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_electrical_engineering.yaml' 2026-09-01T00:17:09,176 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_elementary_mathematics.yaml' 2026-09-01T00:17:09,177 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_formal_logic.yaml' 2026-09-01T00:17:09,178 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_global_facts.yaml' 2026-09-01T00:17:09,180 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_biology.yaml' 2026-09-01T00:17:09,181 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_chemistry.yaml' 2026-09-01T00:17:09,182 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_computer_science.yaml' 2026-09-01T00:17:09,183 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_european_history.yaml' 2026-09-01T00:17:09,184 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_geography.yaml' 2026-09-01T00:17:09,186 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,187 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,188 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_mathematics.yaml' 2026-09-01T00:17:09,189 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_microeconomics.yaml' 2026-09-01T00:17:09,191 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_physics.yaml' 2026-09-01T00:17:09,192 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_psychology.yaml' 2026-09-01T00:17:09,193 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_statistics.yaml' 2026-09-01T00:17:09,194 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_us_history.yaml' 2026-09-01T00:17:09,196 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_high_school_world_history.yaml' 2026-09-01T00:17:09,197 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_aging.yaml' 2026-09-01T00:17:09,198 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_human_sexuality.yaml' 2026-09-01T00:17:09,199 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_international_law.yaml' 2026-09-01T00:17:09,201 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_jurisprudence.yaml' 2026-09-01T00:17:09,202 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_logical_fallacies.yaml' 2026-09-01T00:17:09,203 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_machine_learning.yaml' 2026-09-01T00:17:09,204 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_management.yaml' 2026-09-01T00:17:09,205 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_marketing.yaml' 2026-09-01T00:17:09,206 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_medical_genetics.yaml' 2026-09-01T00:17:09,208 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_miscellaneous.yaml' 2026-09-01T00:17:09,209 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_disputes.yaml' 2026-09-01T00:17:09,210 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_moral_scenarios.yaml' 2026-09-01T00:17:09,211 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_nutrition.yaml' 2026-09-01T00:17:09,212 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_philosophy.yaml' 2026-09-01T00:17:09,213 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_prehistory.yaml' 2026-09-01T00:17:09,214 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_accounting.yaml' 2026-09-01T00:17:09,215 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_law.yaml' 2026-09-01T00:17:09,217 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_medicine.yaml' 2026-09-01T00:17:09,218 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_professional_psychology.yaml' 2026-09-01T00:17:09,219 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_public_relations.yaml' 2026-09-01T00:17:09,220 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_security_studies.yaml' 2026-09-01T00:17:09,221 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_sociology.yaml' 2026-09-01T00:17:09,222 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_us_foreign_policy.yaml' 2026-09-01T00:17:09,223 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_virology.yaml' 2026-09-01T00:17:09,224 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_id_id_world_religions.yaml' 2026-09-01T00:17:09,226 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_abstract_algebra.yaml' 2026-09-01T00:17:09,227 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_anatomy.yaml' 2026-09-01T00:17:09,228 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_astronomy.yaml' 2026-09-01T00:17:09,229 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_business_ethics.yaml' 2026-09-01T00:17:09,230 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_clinical_knowledge.yaml' 2026-09-01T00:17:09,232 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_biology.yaml' 2026-09-01T00:17:09,233 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_chemistry.yaml' 2026-09-01T00:17:09,234 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_computer_science.yaml' 2026-09-01T00:17:09,235 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_mathematics.yaml' 2026-09-01T00:17:09,236 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_medicine.yaml' 2026-09-01T00:17:09,238 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_college_physics.yaml' 2026-09-01T00:17:09,239 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_computer_security.yaml' 2026-09-01T00:17:09,240 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_conceptual_physics.yaml' 2026-09-01T00:17:09,241 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_econometrics.yaml' 2026-09-01T00:17:09,242 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_electrical_engineering.yaml' 2026-09-01T00:17:09,243 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_elementary_mathematics.yaml' 2026-09-01T00:17:09,245 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_formal_logic.yaml' 2026-09-01T00:17:09,246 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_global_facts.yaml' 2026-09-01T00:17:09,247 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_biology.yaml' 2026-09-01T00:17:09,248 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_chemistry.yaml' 2026-09-01T00:17:09,250 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_computer_science.yaml' 2026-09-01T00:17:09,251 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_european_history.yaml' 2026-09-01T00:17:09,252 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_geography.yaml' 2026-09-01T00:17:09,253 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,254 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,255 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_mathematics.yaml' 2026-09-01T00:17:09,257 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_microeconomics.yaml' 2026-09-01T00:17:09,258 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_physics.yaml' 2026-09-01T00:17:09,259 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_psychology.yaml' 2026-09-01T00:17:09,260 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_statistics.yaml' 2026-09-01T00:17:09,261 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_us_history.yaml' 2026-09-01T00:17:09,262 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_high_school_world_history.yaml' 2026-09-01T00:17:09,264 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_aging.yaml' 2026-09-01T00:17:09,265 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_human_sexuality.yaml' 2026-09-01T00:17:09,266 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_international_law.yaml' 2026-09-01T00:17:09,267 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_jurisprudence.yaml' 2026-09-01T00:17:09,268 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_logical_fallacies.yaml' 2026-09-01T00:17:09,269 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_machine_learning.yaml' 2026-09-01T00:17:09,270 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_management.yaml' 2026-09-01T00:17:09,272 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_marketing.yaml' 2026-09-01T00:17:09,273 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_medical_genetics.yaml' 2026-09-01T00:17:09,274 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_miscellaneous.yaml' 2026-09-01T00:17:09,275 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_disputes.yaml' 2026-09-01T00:17:09,276 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_moral_scenarios.yaml' 2026-09-01T00:17:09,277 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_nutrition.yaml' 2026-09-01T00:17:09,279 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_philosophy.yaml' 2026-09-01T00:17:09,280 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_prehistory.yaml' 2026-09-01T00:17:09,281 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_accounting.yaml' 2026-09-01T00:17:09,284 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_law.yaml' 2026-09-01T00:17:09,286 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_medicine.yaml' 2026-09-01T00:17:09,287 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_professional_psychology.yaml' 2026-09-01T00:17:09,288 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_public_relations.yaml' 2026-09-01T00:17:09,289 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_security_studies.yaml' 2026-09-01T00:17:09,291 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_sociology.yaml' 2026-09-01T00:17:09,292 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_us_foreign_policy.yaml' 2026-09-01T00:17:09,293 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_virology.yaml' 2026-09-01T00:17:09,294 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_it_it_world_religions.yaml' 2026-09-01T00:17:09,296 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_abstract_algebra.yaml' 2026-09-01T00:17:09,297 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_anatomy.yaml' 2026-09-01T00:17:09,298 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_astronomy.yaml' 2026-09-01T00:17:09,300 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_business_ethics.yaml' 2026-09-01T00:17:09,301 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_clinical_knowledge.yaml' 2026-09-01T00:17:09,302 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_biology.yaml' 2026-09-01T00:17:09,303 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_chemistry.yaml' 2026-09-01T00:17:09,304 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_computer_science.yaml' 2026-09-01T00:17:09,306 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_mathematics.yaml' 2026-09-01T00:17:09,307 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_medicine.yaml' 2026-09-01T00:17:09,308 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_college_physics.yaml' 2026-09-01T00:17:09,309 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_computer_security.yaml' 2026-09-01T00:17:09,310 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_conceptual_physics.yaml' 2026-09-01T00:17:09,311 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_econometrics.yaml' 2026-09-01T00:17:09,312 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_electrical_engineering.yaml' 2026-09-01T00:17:09,313 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_elementary_mathematics.yaml' 2026-09-01T00:17:09,315 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_formal_logic.yaml' 2026-09-01T00:17:09,316 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_global_facts.yaml' 2026-09-01T00:17:09,317 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_biology.yaml' 2026-09-01T00:17:09,318 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_chemistry.yaml' 2026-09-01T00:17:09,319 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_computer_science.yaml' 2026-09-01T00:17:09,321 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_european_history.yaml' 2026-09-01T00:17:09,322 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_geography.yaml' 2026-09-01T00:17:09,323 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,324 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,325 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_mathematics.yaml' 2026-09-01T00:17:09,327 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_microeconomics.yaml' 2026-09-01T00:17:09,328 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_physics.yaml' 2026-09-01T00:17:09,329 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_psychology.yaml' 2026-09-01T00:17:09,330 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_statistics.yaml' 2026-09-01T00:17:09,331 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_us_history.yaml' 2026-09-01T00:17:09,333 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_high_school_world_history.yaml' 2026-09-01T00:17:09,334 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_aging.yaml' 2026-09-01T00:17:09,335 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_human_sexuality.yaml' 2026-09-01T00:17:09,336 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_international_law.yaml' 2026-09-01T00:17:09,337 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_jurisprudence.yaml' 2026-09-01T00:17:09,338 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_logical_fallacies.yaml' 2026-09-01T00:17:09,340 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_machine_learning.yaml' 2026-09-01T00:17:09,341 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_management.yaml' 2026-09-01T00:17:09,342 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_marketing.yaml' 2026-09-01T00:17:09,343 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_medical_genetics.yaml' 2026-09-01T00:17:09,344 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_miscellaneous.yaml' 2026-09-01T00:17:09,345 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_disputes.yaml' 2026-09-01T00:17:09,346 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_moral_scenarios.yaml' 2026-09-01T00:17:09,347 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_nutrition.yaml' 2026-09-01T00:17:09,349 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_philosophy.yaml' 2026-09-01T00:17:09,350 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_prehistory.yaml' 2026-09-01T00:17:09,351 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_accounting.yaml' 2026-09-01T00:17:09,352 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_law.yaml' 2026-09-01T00:17:09,353 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_medicine.yaml' 2026-09-01T00:17:09,354 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_professional_psychology.yaml' 2026-09-01T00:17:09,355 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_public_relations.yaml' 2026-09-01T00:17:09,356 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_security_studies.yaml' 2026-09-01T00:17:09,357 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_sociology.yaml' 2026-09-01T00:17:09,359 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_us_foreign_policy.yaml' 2026-09-01T00:17:09,360 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_virology.yaml' 2026-09-01T00:17:09,361 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ja_jp_world_religions.yaml' 2026-09-01T00:17:09,362 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_abstract_algebra.yaml' 2026-09-01T00:17:09,363 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_anatomy.yaml' 2026-09-01T00:17:09,364 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_astronomy.yaml' 2026-09-01T00:17:09,365 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_business_ethics.yaml' 2026-09-01T00:17:09,367 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_clinical_knowledge.yaml' 2026-09-01T00:17:09,368 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_biology.yaml' 2026-09-01T00:17:09,369 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_chemistry.yaml' 2026-09-01T00:17:09,370 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_computer_science.yaml' 2026-09-01T00:17:09,371 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_mathematics.yaml' 2026-09-01T00:17:09,373 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_medicine.yaml' 2026-09-01T00:17:09,374 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_college_physics.yaml' 2026-09-01T00:17:09,375 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_computer_security.yaml' 2026-09-01T00:17:09,376 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_conceptual_physics.yaml' 2026-09-01T00:17:09,377 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_econometrics.yaml' 2026-09-01T00:17:09,378 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_electrical_engineering.yaml' 2026-09-01T00:17:09,380 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_elementary_mathematics.yaml' 2026-09-01T00:17:09,381 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_formal_logic.yaml' 2026-09-01T00:17:09,382 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_global_facts.yaml' 2026-09-01T00:17:09,383 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_biology.yaml' 2026-09-01T00:17:09,384 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_chemistry.yaml' 2026-09-01T00:17:09,386 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_computer_science.yaml' 2026-09-01T00:17:09,387 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_european_history.yaml' 2026-09-01T00:17:09,388 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_geography.yaml' 2026-09-01T00:17:09,389 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,390 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,391 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_mathematics.yaml' 2026-09-01T00:17:09,392 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_microeconomics.yaml' 2026-09-01T00:17:09,394 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_physics.yaml' 2026-09-01T00:17:09,395 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_psychology.yaml' 2026-09-01T00:17:09,396 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_statistics.yaml' 2026-09-01T00:17:09,397 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_us_history.yaml' 2026-09-01T00:17:09,398 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_high_school_world_history.yaml' 2026-09-01T00:17:09,399 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_aging.yaml' 2026-09-01T00:17:09,401 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_human_sexuality.yaml' 2026-09-01T00:17:09,402 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_international_law.yaml' 2026-09-01T00:17:09,403 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_jurisprudence.yaml' 2026-09-01T00:17:09,404 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_logical_fallacies.yaml' 2026-09-01T00:17:09,405 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_machine_learning.yaml' 2026-09-01T00:17:09,406 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_management.yaml' 2026-09-01T00:17:09,408 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_marketing.yaml' 2026-09-01T00:17:09,409 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_medical_genetics.yaml' 2026-09-01T00:17:09,410 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_miscellaneous.yaml' 2026-09-01T00:17:09,411 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_disputes.yaml' 2026-09-01T00:17:09,412 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_moral_scenarios.yaml' 2026-09-01T00:17:09,413 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_nutrition.yaml' 2026-09-01T00:17:09,414 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_philosophy.yaml' 2026-09-01T00:17:09,416 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_prehistory.yaml' 2026-09-01T00:17:09,417 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_accounting.yaml' 2026-09-01T00:17:09,418 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_law.yaml' 2026-09-01T00:17:09,419 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_medicine.yaml' 2026-09-01T00:17:09,420 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_professional_psychology.yaml' 2026-09-01T00:17:09,421 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_public_relations.yaml' 2026-09-01T00:17:09,423 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_security_studies.yaml' 2026-09-01T00:17:09,424 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_sociology.yaml' 2026-09-01T00:17:09,425 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_us_foreign_policy.yaml' 2026-09-01T00:17:09,426 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_virology.yaml' 2026-09-01T00:17:09,427 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_ko_kr_world_religions.yaml' 2026-09-01T00:17:09,428 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_abstract_algebra.yaml' 2026-09-01T00:17:09,430 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_anatomy.yaml' 2026-09-01T00:17:09,431 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_astronomy.yaml' 2026-09-01T00:17:09,432 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_business_ethics.yaml' 2026-09-01T00:17:09,433 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_clinical_knowledge.yaml' 2026-09-01T00:17:09,434 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_biology.yaml' 2026-09-01T00:17:09,435 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_chemistry.yaml' 2026-09-01T00:17:09,437 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_computer_science.yaml' 2026-09-01T00:17:09,438 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_mathematics.yaml' 2026-09-01T00:17:09,439 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_medicine.yaml' 2026-09-01T00:17:09,440 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_college_physics.yaml' 2026-09-01T00:17:09,441 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_computer_security.yaml' 2026-09-01T00:17:09,442 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_conceptual_physics.yaml' 2026-09-01T00:17:09,443 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_econometrics.yaml' 2026-09-01T00:17:09,444 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_electrical_engineering.yaml' 2026-09-01T00:17:09,445 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_elementary_mathematics.yaml' 2026-09-01T00:17:09,447 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_formal_logic.yaml' 2026-09-01T00:17:09,448 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_global_facts.yaml' 2026-09-01T00:17:09,449 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_biology.yaml' 2026-09-01T00:17:09,450 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_chemistry.yaml' 2026-09-01T00:17:09,451 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_computer_science.yaml' 2026-09-01T00:17:09,452 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_european_history.yaml' 2026-09-01T00:17:09,453 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_geography.yaml' 2026-09-01T00:17:09,454 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,456 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,457 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_mathematics.yaml' 2026-09-01T00:17:09,458 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_microeconomics.yaml' 2026-09-01T00:17:09,459 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_physics.yaml' 2026-09-01T00:17:09,460 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_psychology.yaml' 2026-09-01T00:17:09,461 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_statistics.yaml' 2026-09-01T00:17:09,463 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_us_history.yaml' 2026-09-01T00:17:09,464 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_high_school_world_history.yaml' 2026-09-01T00:17:09,465 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_aging.yaml' 2026-09-01T00:17:09,466 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_human_sexuality.yaml' 2026-09-01T00:17:09,467 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_international_law.yaml' 2026-09-01T00:17:09,468 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_jurisprudence.yaml' 2026-09-01T00:17:09,469 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_logical_fallacies.yaml' 2026-09-01T00:17:09,471 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_machine_learning.yaml' 2026-09-01T00:17:09,472 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_management.yaml' 2026-09-01T00:17:09,473 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_marketing.yaml' 2026-09-01T00:17:09,474 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_medical_genetics.yaml' 2026-09-01T00:17:09,475 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_miscellaneous.yaml' 2026-09-01T00:17:09,477 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_disputes.yaml' 2026-09-01T00:17:09,478 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_moral_scenarios.yaml' 2026-09-01T00:17:09,479 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_nutrition.yaml' 2026-09-01T00:17:09,480 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_philosophy.yaml' 2026-09-01T00:17:09,481 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_prehistory.yaml' 2026-09-01T00:17:09,482 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_accounting.yaml' 2026-09-01T00:17:09,483 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_law.yaml' 2026-09-01T00:17:09,484 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_medicine.yaml' 2026-09-01T00:17:09,485 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_professional_psychology.yaml' 2026-09-01T00:17:09,486 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_public_relations.yaml' 2026-09-01T00:17:09,488 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_security_studies.yaml' 2026-09-01T00:17:09,489 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_sociology.yaml' 2026-09-01T00:17:09,490 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_us_foreign_policy.yaml' 2026-09-01T00:17:09,491 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_virology.yaml' 2026-09-01T00:17:09,492 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_pt_br_world_religions.yaml' 2026-09-01T00:17:09,493 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_abstract_algebra.yaml' 2026-09-01T00:17:09,494 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_anatomy.yaml' 2026-09-01T00:17:09,495 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_astronomy.yaml' 2026-09-01T00:17:09,497 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_business_ethics.yaml' 2026-09-01T00:17:09,498 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_clinical_knowledge.yaml' 2026-09-01T00:17:09,499 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_biology.yaml' 2026-09-01T00:17:09,500 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_chemistry.yaml' 2026-09-01T00:17:09,501 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_computer_science.yaml' 2026-09-01T00:17:09,502 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_mathematics.yaml' 2026-09-01T00:17:09,503 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_medicine.yaml' 2026-09-01T00:17:09,505 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_college_physics.yaml' 2026-09-01T00:17:09,506 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_computer_security.yaml' 2026-09-01T00:17:09,507 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_conceptual_physics.yaml' 2026-09-01T00:17:09,508 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_econometrics.yaml' 2026-09-01T00:17:09,509 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_electrical_engineering.yaml' 2026-09-01T00:17:09,511 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_elementary_mathematics.yaml' 2026-09-01T00:17:09,512 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_formal_logic.yaml' 2026-09-01T00:17:09,513 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_global_facts.yaml' 2026-09-01T00:17:09,514 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_biology.yaml' 2026-09-01T00:17:09,515 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_chemistry.yaml' 2026-09-01T00:17:09,517 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_computer_science.yaml' 2026-09-01T00:17:09,518 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_european_history.yaml' 2026-09-01T00:17:09,519 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_geography.yaml' 2026-09-01T00:17:09,520 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,521 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,522 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_mathematics.yaml' 2026-09-01T00:17:09,524 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_microeconomics.yaml' 2026-09-01T00:17:09,525 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_physics.yaml' 2026-09-01T00:17:09,526 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_psychology.yaml' 2026-09-01T00:17:09,527 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_statistics.yaml' 2026-09-01T00:17:09,528 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_us_history.yaml' 2026-09-01T00:17:09,529 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_high_school_world_history.yaml' 2026-09-01T00:17:09,530 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_aging.yaml' 2026-09-01T00:17:09,531 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_human_sexuality.yaml' 2026-09-01T00:17:09,532 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_international_law.yaml' 2026-09-01T00:17:09,533 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_jurisprudence.yaml' 2026-09-01T00:17:09,534 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_logical_fallacies.yaml' 2026-09-01T00:17:09,536 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_machine_learning.yaml' 2026-09-01T00:17:09,537 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_management.yaml' 2026-09-01T00:17:09,538 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_marketing.yaml' 2026-09-01T00:17:09,539 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_medical_genetics.yaml' 2026-09-01T00:17:09,540 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_miscellaneous.yaml' 2026-09-01T00:17:09,541 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_disputes.yaml' 2026-09-01T00:17:09,542 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_moral_scenarios.yaml' 2026-09-01T00:17:09,543 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_nutrition.yaml' 2026-09-01T00:17:09,545 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_philosophy.yaml' 2026-09-01T00:17:09,546 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_prehistory.yaml' 2026-09-01T00:17:09,547 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_accounting.yaml' 2026-09-01T00:17:09,548 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_law.yaml' 2026-09-01T00:17:09,549 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_medicine.yaml' 2026-09-01T00:17:09,551 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_professional_psychology.yaml' 2026-09-01T00:17:09,552 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_public_relations.yaml' 2026-09-01T00:17:09,553 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_security_studies.yaml' 2026-09-01T00:17:09,554 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_sociology.yaml' 2026-09-01T00:17:09,555 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_us_foreign_policy.yaml' 2026-09-01T00:17:09,557 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_virology.yaml' 2026-09-01T00:17:09,558 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_sw_ke_world_religions.yaml' 2026-09-01T00:17:09,559 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_abstract_algebra.yaml' 2026-09-01T00:17:09,560 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_anatomy.yaml' 2026-09-01T00:17:09,561 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_astronomy.yaml' 2026-09-01T00:17:09,562 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_business_ethics.yaml' 2026-09-01T00:17:09,563 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_clinical_knowledge.yaml' 2026-09-01T00:17:09,565 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_biology.yaml' 2026-09-01T00:17:09,566 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_chemistry.yaml' 2026-09-01T00:17:09,567 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_computer_science.yaml' 2026-09-01T00:17:09,568 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_mathematics.yaml' 2026-09-01T00:17:09,569 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_medicine.yaml' 2026-09-01T00:17:09,570 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_college_physics.yaml' 2026-09-01T00:17:09,571 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_computer_security.yaml' 2026-09-01T00:17:09,572 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_conceptual_physics.yaml' 2026-09-01T00:17:09,574 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_econometrics.yaml' 2026-09-01T00:17:09,575 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_electrical_engineering.yaml' 2026-09-01T00:17:09,576 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_elementary_mathematics.yaml' 2026-09-01T00:17:09,577 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_formal_logic.yaml' 2026-09-01T00:17:09,578 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_global_facts.yaml' 2026-09-01T00:17:09,579 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_biology.yaml' 2026-09-01T00:17:09,580 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_chemistry.yaml' 2026-09-01T00:17:09,582 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_computer_science.yaml' 2026-09-01T00:17:09,583 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_european_history.yaml' 2026-09-01T00:17:09,584 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_geography.yaml' 2026-09-01T00:17:09,585 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,586 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,587 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_mathematics.yaml' 2026-09-01T00:17:09,588 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_microeconomics.yaml' 2026-09-01T00:17:09,590 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_physics.yaml' 2026-09-01T00:17:09,591 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_psychology.yaml' 2026-09-01T00:17:09,592 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_statistics.yaml' 2026-09-01T00:17:09,593 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_us_history.yaml' 2026-09-01T00:17:09,594 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_high_school_world_history.yaml' 2026-09-01T00:17:09,595 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_aging.yaml' 2026-09-01T00:17:09,597 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_human_sexuality.yaml' 2026-09-01T00:17:09,598 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_international_law.yaml' 2026-09-01T00:17:09,599 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_jurisprudence.yaml' 2026-09-01T00:17:09,600 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_logical_fallacies.yaml' 2026-09-01T00:17:09,601 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_machine_learning.yaml' 2026-09-01T00:17:09,603 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_management.yaml' 2026-09-01T00:17:09,604 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_marketing.yaml' 2026-09-01T00:17:09,605 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_medical_genetics.yaml' 2026-09-01T00:17:09,606 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_miscellaneous.yaml' 2026-09-01T00:17:09,607 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_disputes.yaml' 2026-09-01T00:17:09,608 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_moral_scenarios.yaml' 2026-09-01T00:17:09,610 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_nutrition.yaml' 2026-09-01T00:17:09,611 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_philosophy.yaml' 2026-09-01T00:17:09,612 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_prehistory.yaml' 2026-09-01T00:17:09,613 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_accounting.yaml' 2026-09-01T00:17:09,614 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_law.yaml' 2026-09-01T00:17:09,615 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_medicine.yaml' 2026-09-01T00:17:09,616 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_professional_psychology.yaml' 2026-09-01T00:17:09,618 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_public_relations.yaml' 2026-09-01T00:17:09,619 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_security_studies.yaml' 2026-09-01T00:17:09,620 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_sociology.yaml' 2026-09-01T00:17:09,621 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_us_foreign_policy.yaml' 2026-09-01T00:17:09,622 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_virology.yaml' 2026-09-01T00:17:09,623 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_yo_ng_world_religions.yaml' 2026-09-01T00:17:09,624 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_abstract_algebra.yaml' 2026-09-01T00:17:09,625 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_anatomy.yaml' 2026-09-01T00:17:09,626 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_astronomy.yaml' 2026-09-01T00:17:09,628 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_business_ethics.yaml' 2026-09-01T00:17:09,629 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_clinical_knowledge.yaml' 2026-09-01T00:17:09,630 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_biology.yaml' 2026-09-01T00:17:09,631 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_chemistry.yaml' 2026-09-01T00:17:09,632 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_computer_science.yaml' 2026-09-01T00:17:09,633 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_mathematics.yaml' 2026-09-01T00:17:09,634 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_medicine.yaml' 2026-09-01T00:17:09,636 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_college_physics.yaml' 2026-09-01T00:17:09,637 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_computer_security.yaml' 2026-09-01T00:17:09,638 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_conceptual_physics.yaml' 2026-09-01T00:17:09,639 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_econometrics.yaml' 2026-09-01T00:17:09,640 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_electrical_engineering.yaml' 2026-09-01T00:17:09,641 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_elementary_mathematics.yaml' 2026-09-01T00:17:09,643 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_formal_logic.yaml' 2026-09-01T00:17:09,644 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_global_facts.yaml' 2026-09-01T00:17:09,645 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_biology.yaml' 2026-09-01T00:17:09,646 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_chemistry.yaml' 2026-09-01T00:17:09,647 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_computer_science.yaml' 2026-09-01T00:17:09,649 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_european_history.yaml' 2026-09-01T00:17:09,650 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_geography.yaml' 2026-09-01T00:17:09,651 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_government_and_politics.yaml' 2026-09-01T00:17:09,652 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_macroeconomics.yaml' 2026-09-01T00:17:09,653 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_mathematics.yaml' 2026-09-01T00:17:09,655 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_microeconomics.yaml' 2026-09-01T00:17:09,656 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_physics.yaml' 2026-09-01T00:17:09,657 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_psychology.yaml' 2026-09-01T00:17:09,658 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_statistics.yaml' 2026-09-01T00:17:09,659 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_us_history.yaml' 2026-09-01T00:17:09,660 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_high_school_world_history.yaml' 2026-09-01T00:17:09,661 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_aging.yaml' 2026-09-01T00:17:09,662 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_human_sexuality.yaml' 2026-09-01T00:17:09,663 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_international_law.yaml' 2026-09-01T00:17:09,665 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_jurisprudence.yaml' 2026-09-01T00:17:09,666 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_logical_fallacies.yaml' 2026-09-01T00:17:09,667 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_machine_learning.yaml' 2026-09-01T00:17:09,668 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_management.yaml' 2026-09-01T00:17:09,669 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_marketing.yaml' 2026-09-01T00:17:09,670 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_medical_genetics.yaml' 2026-09-01T00:17:09,671 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_miscellaneous.yaml' 2026-09-01T00:17:09,673 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_disputes.yaml' 2026-09-01T00:17:09,674 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_moral_scenarios.yaml' 2026-09-01T00:17:09,675 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_nutrition.yaml' 2026-09-01T00:17:09,676 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_philosophy.yaml' 2026-09-01T00:17:09,677 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_prehistory.yaml' 2026-09-01T00:17:09,678 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_accounting.yaml' 2026-09-01T00:17:09,679 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_law.yaml' 2026-09-01T00:17:09,681 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_medicine.yaml' 2026-09-01T00:17:09,682 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_professional_psychology.yaml' 2026-09-01T00:17:09,683 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_public_relations.yaml' 2026-09-01T00:17:09,684 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_security_studies.yaml' 2026-09-01T00:17:09,685 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_sociology.yaml' 2026-09-01T00:17:09,686 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_us_foreign_policy.yaml' 2026-09-01T00:17:09,688 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_virology.yaml' 2026-09-01T00:17:09,689 adding 'lm_eval/tasks/openai-mmmlu/default/mmmlu_zh_cn_world_religions.yaml' 2026-09-01T00:17:09,690 adding 'lm_eval/tasks/openai-mmmlu/default/utils.py' 2026-09-01T00:17:09,692 adding 'lm_eval/tasks/openbookqa/README.md' 2026-09-01T00:17:09,693 adding 'lm_eval/tasks/openbookqa/openbookqa.yaml' 2026-09-01T00:17:09,695 adding 'lm_eval/tasks/paloma/README.md' 2026-09-01T00:17:09,697 adding 'lm_eval/tasks/paloma/_paloma_template' 2026-09-01T00:17:09,698 adding 'lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml' 2026-09-01T00:17:09,699 adding 'lm_eval/tasks/paloma/paloma_c4_100_domains.yaml' 2026-09-01T00:17:09,700 adding 'lm_eval/tasks/paloma/paloma_c4_en.yaml' 2026-09-01T00:17:09,701 adding 'lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml' 2026-09-01T00:17:09,702 adding 'lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml' 2026-09-01T00:17:09,703 adding 'lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml' 2026-09-01T00:17:09,705 adding 'lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml' 2026-09-01T00:17:09,706 adding 'lm_eval/tasks/paloma/paloma_gab.yaml' 2026-09-01T00:17:09,707 adding 'lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml' 2026-09-01T00:17:09,708 adding 'lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml' 2026-09-01T00:17:09,709 adding 'lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml' 2026-09-01T00:17:09,710 adding 'lm_eval/tasks/paloma/paloma_mc4.yaml' 2026-09-01T00:17:09,711 adding 'lm_eval/tasks/paloma/paloma_ptb.yaml' 2026-09-01T00:17:09,712 adding 'lm_eval/tasks/paloma/paloma_redpajama.yaml' 2026-09-01T00:17:09,713 adding 'lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml' 2026-09-01T00:17:09,714 adding 'lm_eval/tasks/paloma/paloma_utils.py' 2026-09-01T00:17:09,715 adding 'lm_eval/tasks/paloma/paloma_wikitext_103.yaml' 2026-09-01T00:17:09,717 adding 'lm_eval/tasks/paws-x/README.md' 2026-09-01T00:17:09,718 adding 'lm_eval/tasks/paws-x/_generate_config.py' 2026-09-01T00:17:09,719 adding 'lm_eval/tasks/paws-x/_pawsx.yaml' 2026-09-01T00:17:09,720 adding 'lm_eval/tasks/paws-x/paws_de.yaml' 2026-09-01T00:17:09,721 adding 'lm_eval/tasks/paws-x/paws_en.yaml' 2026-09-01T00:17:09,722 adding 'lm_eval/tasks/paws-x/paws_es.yaml' 2026-09-01T00:17:09,723 adding 'lm_eval/tasks/paws-x/paws_fr.yaml' 2026-09-01T00:17:09,724 adding 'lm_eval/tasks/paws-x/paws_ja.yaml' 2026-09-01T00:17:09,726 adding 'lm_eval/tasks/paws-x/paws_ko.yaml' 2026-09-01T00:17:09,727 adding 'lm_eval/tasks/paws-x/paws_zh.yaml' 2026-09-01T00:17:09,728 adding 'lm_eval/tasks/paws-x/pawsx_template_yaml' 2026-09-01T00:17:09,729 adding 'lm_eval/tasks/paws-x/utils.py' 2026-09-01T00:17:09,731 adding 'lm_eval/tasks/physics_gre/README.md' 2026-09-01T00:17:09,732 adding 'lm_eval/tasks/physics_gre/_physics_gre_template_yaml' 2026-09-01T00:17:09,733 adding 'lm_eval/tasks/physics_gre/physics_gre.yaml' 2026-09-01T00:17:09,734 adding 'lm_eval/tasks/physics_gre/physics_gre_additional.yaml' 2026-09-01T00:17:09,736 adding 'lm_eval/tasks/physics_gre/physics_gre_all.yaml' 2026-09-01T00:17:09,737 adding 'lm_eval/tasks/physics_gre/utils.py' 2026-09-01T00:17:09,739 adding 'lm_eval/tasks/pile/README.md' 2026-09-01T00:17:09,740 adding 'lm_eval/tasks/pile/pile_arxiv.yaml' 2026-09-01T00:17:09,741 adding 'lm_eval/tasks/pile/pile_bookcorpus2.yaml' 2026-09-01T00:17:09,742 adding 'lm_eval/tasks/pile/pile_books3.yaml' 2026-09-01T00:17:09,743 adding 'lm_eval/tasks/pile/pile_dm-mathematics.yaml' 2026-09-01T00:17:09,744 adding 'lm_eval/tasks/pile/pile_enron.yaml' 2026-09-01T00:17:09,746 adding 'lm_eval/tasks/pile/pile_europarl.yaml' 2026-09-01T00:17:09,747 adding 'lm_eval/tasks/pile/pile_freelaw.yaml' 2026-09-01T00:17:09,748 adding 'lm_eval/tasks/pile/pile_github.yaml' 2026-09-01T00:17:09,749 adding 'lm_eval/tasks/pile/pile_gutenberg.yaml' 2026-09-01T00:17:09,750 adding 'lm_eval/tasks/pile/pile_hackernews.yaml' 2026-09-01T00:17:09,751 adding 'lm_eval/tasks/pile/pile_nih-exporter.yaml' 2026-09-01T00:17:09,752 adding 'lm_eval/tasks/pile/pile_opensubtitles.yaml' 2026-09-01T00:17:09,753 adding 'lm_eval/tasks/pile/pile_openwebtext2.yaml' 2026-09-01T00:17:09,754 adding 'lm_eval/tasks/pile/pile_philpapers.yaml' 2026-09-01T00:17:09,755 adding 'lm_eval/tasks/pile/pile_pile-cc.yaml' 2026-09-01T00:17:09,757 adding 'lm_eval/tasks/pile/pile_pubmed-abstracts.yaml' 2026-09-01T00:17:09,758 adding 'lm_eval/tasks/pile/pile_pubmed-central.yaml' 2026-09-01T00:17:09,759 adding 'lm_eval/tasks/pile/pile_stackexchange.yaml' 2026-09-01T00:17:09,760 adding 'lm_eval/tasks/pile/pile_ubuntu-irc.yaml' 2026-09-01T00:17:09,761 adding 'lm_eval/tasks/pile/pile_uspto.yaml' 2026-09-01T00:17:09,762 adding 'lm_eval/tasks/pile/pile_wikipedia.yaml' 2026-09-01T00:17:09,763 adding 'lm_eval/tasks/pile/pile_youtubesubtitles.yaml' 2026-09-01T00:17:09,765 adding 'lm_eval/tasks/pile_10k/README.md' 2026-09-01T00:17:09,766 adding 'lm_eval/tasks/pile_10k/pile_10k.yaml' 2026-09-01T00:17:09,768 adding 'lm_eval/tasks/piqa/README.md' 2026-09-01T00:17:09,769 adding 'lm_eval/tasks/piqa/piqa.yaml' 2026-09-01T00:17:09,771 adding 'lm_eval/tasks/pisa/README.md' 2026-09-01T00:17:09,773 adding 'lm_eval/tasks/pisa/_pisa.yaml' 2026-09-01T00:17:09,774 adding 'lm_eval/tasks/pisa/_pisa_llm_judged.yaml' 2026-09-01T00:17:09,775 adding 'lm_eval/tasks/pisa/_template_yaml' 2026-09-01T00:17:09,776 adding 'lm_eval/tasks/pisa/pisa_ch.yaml' 2026-09-01T00:17:09,777 adding 'lm_eval/tasks/pisa/pisa_ch_llm_judged.yaml' 2026-09-01T00:17:09,778 adding 'lm_eval/tasks/pisa/pisa_de.yaml' 2026-09-01T00:17:09,779 adding 'lm_eval/tasks/pisa/pisa_de_llm_judged.yaml' 2026-09-01T00:17:09,780 adding 'lm_eval/tasks/pisa/pisa_en.yaml' 2026-09-01T00:17:09,781 adding 'lm_eval/tasks/pisa/pisa_en_llm_judged.yaml' 2026-09-01T00:17:09,782 adding 'lm_eval/tasks/pisa/pisa_es.yaml' 2026-09-01T00:17:09,783 adding 'lm_eval/tasks/pisa/pisa_es_llm_judged.yaml' 2026-09-01T00:17:09,784 adding 'lm_eval/tasks/pisa/pisa_fr.yaml' 2026-09-01T00:17:09,785 adding 'lm_eval/tasks/pisa/pisa_fr_llm_judged.yaml' 2026-09-01T00:17:09,786 adding 'lm_eval/tasks/pisa/pisa_it.yaml' 2026-09-01T00:17:09,787 adding 'lm_eval/tasks/pisa/pisa_it_llm_judged.yaml' 2026-09-01T00:17:09,789 adding 'lm_eval/tasks/pisa/utils.py' 2026-09-01T00:17:09,791 adding 'lm_eval/tasks/polemo2/README.md' 2026-09-01T00:17:09,792 adding 'lm_eval/tasks/polemo2/polemo2_in.yaml' 2026-09-01T00:17:09,794 adding 'lm_eval/tasks/polemo2/polemo2_out.yaml' 2026-09-01T00:17:09,796 adding 'lm_eval/tasks/portuguese_bench/README.md' 2026-09-01T00:17:09,797 adding 'lm_eval/tasks/portuguese_bench/assin2_rte.yaml' 2026-09-01T00:17:09,798 adding 'lm_eval/tasks/portuguese_bench/assin2_sts.yaml' 2026-09-01T00:17:09,799 adding 'lm_eval/tasks/portuguese_bench/assin2_utils.py' 2026-09-01T00:17:09,800 adding 'lm_eval/tasks/portuguese_bench/assin_entailment.yaml' 2026-09-01T00:17:09,801 adding 'lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml' 2026-09-01T00:17:09,802 adding 'lm_eval/tasks/portuguese_bench/portuguese_bench.yaml' 2026-09-01T00:17:09,804 adding 'lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml' 2026-09-01T00:17:09,806 adding 'lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py' 2026-09-01T00:17:09,807 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml' 2026-09-01T00:17:09,808 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml' 2026-09-01T00:17:09,809 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml' 2026-09-01T00:17:09,811 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml' 2026-09-01T00:17:09,812 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml' 2026-09-01T00:17:09,813 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml' 2026-09-01T00:17:09,814 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml' 2026-09-01T00:17:09,815 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml' 2026-09-01T00:17:09,816 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml' 2026-09-01T00:17:09,818 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml' 2026-09-01T00:17:09,819 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml' 2026-09-01T00:17:09,820 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml' 2026-09-01T00:17:09,821 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml' 2026-09-01T00:17:09,822 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml' 2026-09-01T00:17:09,824 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml' 2026-09-01T00:17:09,825 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml' 2026-09-01T00:17:09,826 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml' 2026-09-01T00:17:09,828 adding 'lm_eval/tasks/prost/README.md' 2026-09-01T00:17:09,829 adding 'lm_eval/tasks/prost/corypaik_prost.yaml' 2026-09-01T00:17:09,831 adding 'lm_eval/tasks/pubmedqa/README.md' 2026-09-01T00:17:09,832 adding 'lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py' 2026-09-01T00:17:09,834 adding 'lm_eval/tasks/pubmedqa/pubmedqa.yaml' 2026-09-01T00:17:09,836 adding 'lm_eval/tasks/putnam_axiom/README.md' 2026-09-01T00:17:09,837 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom.yaml' 2026-09-01T00:17:09,838 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom_original.yaml' 2026-09-01T00:17:09,839 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom_variations.yaml' 2026-09-01T00:17:09,840 adding 'lm_eval/tasks/putnam_axiom/putnam_axiom_variations_org.yaml' 2026-09-01T00:17:09,842 adding 'lm_eval/tasks/putnam_axiom/utils.py' 2026-09-01T00:17:09,844 adding 'lm_eval/tasks/qa4mre/README.md' 2026-09-01T00:17:09,845 adding 'lm_eval/tasks/qa4mre/preprocess_qa4mre.py' 2026-09-01T00:17:09,846 adding 'lm_eval/tasks/qa4mre/qa4mre_2011.yaml' 2026-09-01T00:17:09,847 adding 'lm_eval/tasks/qa4mre/qa4mre_2012.yaml' 2026-09-01T00:17:09,848 adding 'lm_eval/tasks/qa4mre/qa4mre_2013.yaml' 2026-09-01T00:17:09,850 adding 'lm_eval/tasks/qasper/README.md' 2026-09-01T00:17:09,851 adding 'lm_eval/tasks/qasper/bool.yaml' 2026-09-01T00:17:09,852 adding 'lm_eval/tasks/qasper/freeform.yaml' 2026-09-01T00:17:09,854 adding 'lm_eval/tasks/qasper/metrics.py' 2026-09-01T00:17:09,855 adding 'lm_eval/tasks/qasper/utils.py' 2026-09-01T00:17:09,857 adding 'lm_eval/tasks/race/README.md' 2026-09-01T00:17:09,858 adding 'lm_eval/tasks/race/preprocess_race.py' 2026-09-01T00:17:09,859 adding 'lm_eval/tasks/race/race.yaml' 2026-09-01T00:17:09,862 adding 'lm_eval/tasks/realtoxicityprompts/metric.py' 2026-09-01T00:17:09,863 adding 'lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml' 2026-09-01T00:17:09,865 adding 'lm_eval/tasks/ruler/README.md' 2026-09-01T00:17:09,866 adding 'lm_eval/tasks/ruler/common_utils.py' 2026-09-01T00:17:09,867 adding 'lm_eval/tasks/ruler/cwe.yaml' 2026-09-01T00:17:09,869 adding 'lm_eval/tasks/ruler/cwe_utils.py' 2026-09-01T00:17:09,870 adding 'lm_eval/tasks/ruler/essays.py' 2026-09-01T00:17:09,871 adding 'lm_eval/tasks/ruler/fwe.yaml' 2026-09-01T00:17:09,873 adding 'lm_eval/tasks/ruler/fwe_utils.py' 2026-09-01T00:17:09,874 adding 'lm_eval/tasks/ruler/niah_multikey_1.yaml' 2026-09-01T00:17:09,875 adding 'lm_eval/tasks/ruler/niah_multikey_2.yaml' 2026-09-01T00:17:09,877 adding 'lm_eval/tasks/ruler/niah_multikey_3.yaml' 2026-09-01T00:17:09,878 adding 'lm_eval/tasks/ruler/niah_multiquery.yaml' 2026-09-01T00:17:09,879 adding 'lm_eval/tasks/ruler/niah_multivalue.yaml' 2026-09-01T00:17:09,880 adding 'lm_eval/tasks/ruler/niah_single_1.yaml' 2026-09-01T00:17:09,881 adding 'lm_eval/tasks/ruler/niah_single_2.yaml' 2026-09-01T00:17:09,882 adding 'lm_eval/tasks/ruler/niah_single_3.yaml' 2026-09-01T00:17:09,884 adding 'lm_eval/tasks/ruler/niah_utils.py' 2026-09-01T00:17:09,886 adding 'lm_eval/tasks/ruler/prepare_niah.py' 2026-09-01T00:17:09,887 adding 'lm_eval/tasks/ruler/qa_hotpot.yaml' 2026-09-01T00:17:09,888 adding 'lm_eval/tasks/ruler/qa_squad.yaml' 2026-09-01T00:17:09,890 adding 'lm_eval/tasks/ruler/qa_utils.py' 2026-09-01T00:17:09,891 adding 'lm_eval/tasks/ruler/ruler.yaml' 2026-09-01T00:17:09,893 adding 'lm_eval/tasks/ruler/vt.yaml' 2026-09-01T00:17:09,894 adding 'lm_eval/tasks/ruler/vt_utils.py' 2026-09-01T00:17:09,896 adding 'lm_eval/tasks/sciq/README.md' 2026-09-01T00:17:09,898 adding 'lm_eval/tasks/sciq/sciq.yaml' 2026-09-01T00:17:09,900 adding 'lm_eval/tasks/score/NON_GREEDY.md' 2026-09-01T00:17:09,901 adding 'lm_eval/tasks/score/README.md' 2026-09-01T00:17:09,903 adding 'lm_eval/tasks/score/non_greedy.sh' 2026-09-01T00:17:09,904 adding 'lm_eval/tasks/score/non_greedy_summarizer.py' 2026-09-01T00:17:09,906 adding 'lm_eval/tasks/score/score_robustness.yaml' 2026-09-01T00:17:09,908 adding 'lm_eval/tasks/score/utils.py' 2026-09-01T00:17:09,910 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml' 2026-09-01T00:17:09,911 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml' 2026-09-01T00:17:09,912 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml' 2026-09-01T00:17:09,914 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml' 2026-09-01T00:17:09,915 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml' 2026-09-01T00:17:09,916 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml' 2026-09-01T00:17:09,917 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml' 2026-09-01T00:17:09,918 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml' 2026-09-01T00:17:09,920 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml' 2026-09-01T00:17:09,921 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml' 2026-09-01T00:17:09,922 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml' 2026-09-01T00:17:09,923 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml' 2026-09-01T00:17:09,924 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml' 2026-09-01T00:17:09,926 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml' 2026-09-01T00:17:09,927 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml' 2026-09-01T00:17:09,928 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml' 2026-09-01T00:17:09,929 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml' 2026-09-01T00:17:09,930 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml' 2026-09-01T00:17:09,932 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml' 2026-09-01T00:17:09,933 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml' 2026-09-01T00:17:09,934 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml' 2026-09-01T00:17:09,935 adding 'lm_eval/tasks/score/agi_eval/prompt_templates.json' 2026-09-01T00:17:09,937 adding 'lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml' 2026-09-01T00:17:09,938 adding 'lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml' 2026-09-01T00:17:09,939 adding 'lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml' 2026-09-01T00:17:09,941 adding 'lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml' 2026-09-01T00:17:09,942 adding 'lm_eval/tasks/score/agi_eval/utils_agieval.py' 2026-09-01T00:17:09,946 adding 'lm_eval/tasks/score/math/math_grader.py' 2026-09-01T00:17:09,947 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml' 2026-09-01T00:17:09,948 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml' 2026-09-01T00:17:09,949 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml' 2026-09-01T00:17:09,951 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml' 2026-09-01T00:17:09,952 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml' 2026-09-01T00:17:09,953 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml' 2026-09-01T00:17:09,954 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml' 2026-09-01T00:17:09,956 adding 'lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml' 2026-09-01T00:17:09,957 adding 'lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml' 2026-09-01T00:17:09,958 adding 'lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml' 2026-09-01T00:17:09,959 adding 'lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml' 2026-09-01T00:17:09,961 adding 'lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml' 2026-09-01T00:17:09,962 adding 'lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml' 2026-09-01T00:17:09,963 adding 'lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml' 2026-09-01T00:17:09,964 adding 'lm_eval/tasks/score/math/prompt_templates.json' 2026-09-01T00:17:09,966 adding 'lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml' 2026-09-01T00:17:09,967 adding 'lm_eval/tasks/score/math/score_prompt_robustness_math.yaml' 2026-09-01T00:17:09,968 adding 'lm_eval/tasks/score/math/score_robustness_math.yaml' 2026-09-01T00:17:09,970 adding 'lm_eval/tasks/score/math/to_be_fixed_questions.json' 2026-09-01T00:17:09,971 adding 'lm_eval/tasks/score/math/utils_math.py' 2026-09-01T00:17:09,973 adding 'lm_eval/tasks/score/mmlu_pro/prompt_templates.json' 2026-09-01T00:17:09,974 adding 'lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml' 2026-09-01T00:17:09,976 adding 'lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml' 2026-09-01T00:17:09,977 adding 'lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml' 2026-09-01T00:17:09,978 adding 'lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py' 2026-09-01T00:17:09,980 adding 'lm_eval/tasks/scrolls/README.md' 2026-09-01T00:17:09,981 adding 'lm_eval/tasks/scrolls/scrolls_contractnli.yaml' 2026-09-01T00:17:09,982 adding 'lm_eval/tasks/scrolls/scrolls_govreport.yaml' 2026-09-01T00:17:09,983 adding 'lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml' 2026-09-01T00:17:09,984 adding 'lm_eval/tasks/scrolls/scrolls_qasper.yaml' 2026-09-01T00:17:09,986 adding 'lm_eval/tasks/scrolls/scrolls_qmsum.yaml' 2026-09-01T00:17:09,987 adding 'lm_eval/tasks/scrolls/scrolls_quality.yaml' 2026-09-01T00:17:09,988 adding 'lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml' 2026-09-01T00:17:09,990 adding 'lm_eval/tasks/scrolls/task.py' 2026-09-01T00:17:09,992 adding 'lm_eval/tasks/simple_cooccurrence_bias/README.md' 2026-09-01T00:17:09,993 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias.yaml' 2026-09-01T00:17:09,994 adding 'lm_eval/tasks/simple_cooccurrence_bias/simple_cooccurrence_bias_gen.yaml' 2026-09-01T00:17:09,995 adding 'lm_eval/tasks/simple_cooccurrence_bias/utils.py' 2026-09-01T00:17:09,997 adding 'lm_eval/tasks/siqa/README.md' 2026-09-01T00:17:09,998 adding 'lm_eval/tasks/siqa/siqa.yaml' 2026-09-01T00:17:10,000 adding 'lm_eval/tasks/slr_bench/README.md' 2026-09-01T00:17:10,001 adding 'lm_eval/tasks/slr_bench/lm_eval_slr_bench.py' 2026-09-01T00:17:10,002 adding 'lm_eval/tasks/slr_bench/slr_bench_all.yaml' 2026-09-01T00:17:10,004 adding 'lm_eval/tasks/slr_bench/slr_bench_basic.yaml' 2026-09-01T00:17:10,005 adding 'lm_eval/tasks/slr_bench/slr_bench_common_yaml' 2026-09-01T00:17:10,006 adding 'lm_eval/tasks/slr_bench/slr_bench_easy.yaml' 2026-09-01T00:17:10,007 adding 'lm_eval/tasks/slr_bench/slr_bench_group.yaml' 2026-09-01T00:17:10,008 adding 'lm_eval/tasks/slr_bench/slr_bench_hard.yaml' 2026-09-01T00:17:10,009 adding 'lm_eval/tasks/slr_bench/slr_bench_medium.yaml' 2026-09-01T00:17:10,012 adding 'lm_eval/tasks/spanish_bench/README.md' 2026-09-01T00:17:10,013 adding 'lm_eval/tasks/spanish_bench/cocoteros_es.yaml' 2026-09-01T00:17:10,014 adding 'lm_eval/tasks/spanish_bench/copa_es.yaml' 2026-09-01T00:17:10,016 adding 'lm_eval/tasks/spanish_bench/escola.yaml' 2026-09-01T00:17:10,017 adding 'lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml' 2026-09-01T00:17:10,018 adding 'lm_eval/tasks/spanish_bench/openbookqa_es.yaml' 2026-09-01T00:17:10,019 adding 'lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml' 2026-09-01T00:17:10,020 adding 'lm_eval/tasks/spanish_bench/spanish_bench.yaml' 2026-09-01T00:17:10,022 adding 'lm_eval/tasks/spanish_bench/utils.py' 2026-09-01T00:17:10,023 adding 'lm_eval/tasks/spanish_bench/wnli_es.yaml' 2026-09-01T00:17:10,024 adding 'lm_eval/tasks/spanish_bench/xlsum_es.yaml' 2026-09-01T00:17:10,025 adding 'lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml' 2026-09-01T00:17:10,027 adding 'lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml' 2026-09-01T00:17:10,029 adding 'lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py' 2026-09-01T00:17:10,030 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml' 2026-09-01T00:17:10,031 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml' 2026-09-01T00:17:10,033 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml' 2026-09-01T00:17:10,034 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml' 2026-09-01T00:17:10,035 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml' 2026-09-01T00:17:10,036 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml' 2026-09-01T00:17:10,037 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml' 2026-09-01T00:17:10,038 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml' 2026-09-01T00:17:10,039 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml' 2026-09-01T00:17:10,040 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml' 2026-09-01T00:17:10,041 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml' 2026-09-01T00:17:10,042 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml' 2026-09-01T00:17:10,043 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml' 2026-09-01T00:17:10,044 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml' 2026-09-01T00:17:10,046 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml' 2026-09-01T00:17:10,047 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml' 2026-09-01T00:17:10,048 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml' 2026-09-01T00:17:10,049 adding 'lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common' 2026-09-01T00:17:10,050 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml' 2026-09-01T00:17:10,052 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml' 2026-09-01T00:17:10,053 adding 'lm_eval/tasks/squad_completion/README.md' 2026-09-01T00:17:10,054 adding 'lm_eval/tasks/squad_completion/squad_completion.yaml' 2026-09-01T00:17:10,056 adding 'lm_eval/tasks/squad_completion/task.py' 2026-09-01T00:17:10,058 adding 'lm_eval/tasks/squadv2/README.md' 2026-09-01T00:17:10,059 adding 'lm_eval/tasks/squadv2/squadv2.yaml' 2026-09-01T00:17:10,060 adding 'lm_eval/tasks/squadv2/task.py' 2026-09-01T00:17:10,062 adding 'lm_eval/tasks/storycloze/README.md' 2026-09-01T00:17:10,063 adding 'lm_eval/tasks/storycloze/storycloze_2016.yaml' 2026-09-01T00:17:10,064 adding 'lm_eval/tasks/storycloze/storycloze_2018.yaml' 2026-09-01T00:17:10,066 adding 'lm_eval/tasks/super_glue/README.md' 2026-09-01T00:17:10,068 adding 'lm_eval/tasks/super_glue/boolq/default.yaml' 2026-09-01T00:17:10,069 adding 'lm_eval/tasks/super_glue/boolq/seq2seq.yaml' 2026-09-01T00:17:10,071 adding 'lm_eval/tasks/super_glue/boolq/t5-prompt.yaml' 2026-09-01T00:17:10,072 adding 'lm_eval/tasks/super_glue/cb/aggregate.py' 2026-09-01T00:17:10,074 adding 'lm_eval/tasks/super_glue/cb/default.yaml' 2026-09-01T00:17:10,075 adding 'lm_eval/tasks/super_glue/cb/t5-prompt.yaml' 2026-09-01T00:17:10,076 adding 'lm_eval/tasks/super_glue/cb/t5_utils.py' 2026-09-01T00:17:10,078 adding 'lm_eval/tasks/super_glue/copa/default.yaml' 2026-09-01T00:17:10,079 adding 'lm_eval/tasks/super_glue/copa/t5-prompt.yaml' 2026-09-01T00:17:10,080 adding 'lm_eval/tasks/super_glue/copa/utils.py' 2026-09-01T00:17:10,082 adding 'lm_eval/tasks/super_glue/multirc/default.yaml' 2026-09-01T00:17:10,083 adding 'lm_eval/tasks/super_glue/multirc/t5-prompt.yaml' 2026-09-01T00:17:10,085 adding 'lm_eval/tasks/super_glue/multirc/t5_utils.py' 2026-09-01T00:17:10,086 adding 'lm_eval/tasks/super_glue/record/default.yaml' 2026-09-01T00:17:10,088 adding 'lm_eval/tasks/super_glue/record/t5-prompt.yaml' 2026-09-01T00:17:10,089 adding 'lm_eval/tasks/super_glue/record/t5_utils.py' 2026-09-01T00:17:10,090 adding 'lm_eval/tasks/super_glue/record/util.py' 2026-09-01T00:17:10,092 adding 'lm_eval/tasks/super_glue/rte/default.yaml' 2026-09-01T00:17:10,093 adding 'lm_eval/tasks/super_glue/rte/t5-prompt.yaml' 2026-09-01T00:17:10,095 adding 'lm_eval/tasks/super_glue/wic/default.yaml' 2026-09-01T00:17:10,096 adding 'lm_eval/tasks/super_glue/wic/t5-prompt.yaml' 2026-09-01T00:17:10,098 adding 'lm_eval/tasks/super_glue/wsc/default.yaml' 2026-09-01T00:17:10,099 adding 'lm_eval/tasks/super_glue/wsc/preprocess_wsc.py' 2026-09-01T00:17:10,100 adding 'lm_eval/tasks/super_glue/wsc/t5-prompt.yaml' 2026-09-01T00:17:10,102 adding 'lm_eval/tasks/super_glue/wsc/t5_utils.py' 2026-09-01T00:17:10,103 adding 'lm_eval/tasks/swag/README.md' 2026-09-01T00:17:10,104 adding 'lm_eval/tasks/swag/swag.yaml' 2026-09-01T00:17:10,107 adding 'lm_eval/tasks/swde/README.md' 2026-09-01T00:17:10,108 adding 'lm_eval/tasks/swde/swde.yaml' 2026-09-01T00:17:10,109 adding 'lm_eval/tasks/swde/task.py' 2026-09-01T00:17:10,111 adding 'lm_eval/tasks/tinyBenchmarks/README.md' 2026-09-01T00:17:10,112 adding 'lm_eval/tasks/tinyBenchmarks/agg_functions.py' 2026-09-01T00:17:10,113 adding 'lm_eval/tasks/tinyBenchmarks/tinyArc.yaml' 2026-09-01T00:17:10,114 adding 'lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml' 2026-09-01T00:17:10,116 adding 'lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml' 2026-09-01T00:17:10,117 adding 'lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml' 2026-09-01T00:17:10,118 adding 'lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml' 2026-09-01T00:17:10,119 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml' 2026-09-01T00:17:10,120 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml' 2026-09-01T00:17:10,122 adding 'lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml' 2026-09-01T00:17:10,123 adding 'lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py' 2026-09-01T00:17:10,124 adding 'lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py' 2026-09-01T00:17:10,125 adding 'lm_eval/tasks/tinyBenchmarks/utils_winogrande.py' 2026-09-01T00:17:10,127 adding 'lm_eval/tasks/tmlu/README.md' 2026-09-01T00:17:10,129 adding 'lm_eval/tasks/tmlu/subject.tsv' 2026-09-01T00:17:10,131 adding 'lm_eval/tasks/tmlu/default/_default_template_yaml' 2026-09-01T00:17:10,133 adding 'lm_eval/tasks/tmlu/default/_generate_configs.py' 2026-09-01T00:17:10,134 adding 'lm_eval/tasks/tmlu/default/_tmlu.yaml' 2026-09-01T00:17:10,135 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml' 2026-09-01T00:17:10,137 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml' 2026-09-01T00:17:10,138 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml' 2026-09-01T00:17:10,139 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml' 2026-09-01T00:17:10,140 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml' 2026-09-01T00:17:10,141 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml' 2026-09-01T00:17:10,143 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml' 2026-09-01T00:17:10,144 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml' 2026-09-01T00:17:10,145 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml' 2026-09-01T00:17:10,146 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml' 2026-09-01T00:17:10,147 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml' 2026-09-01T00:17:10,149 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml' 2026-09-01T00:17:10,150 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml' 2026-09-01T00:17:10,151 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml' 2026-09-01T00:17:10,152 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml' 2026-09-01T00:17:10,154 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml' 2026-09-01T00:17:10,155 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml' 2026-09-01T00:17:10,156 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml' 2026-09-01T00:17:10,157 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml' 2026-09-01T00:17:10,159 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml' 2026-09-01T00:17:10,160 adding 'lm_eval/tasks/tmlu/default/tmlu_accountant.yaml' 2026-09-01T00:17:10,161 adding 'lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml' 2026-09-01T00:17:10,162 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml' 2026-09-01T00:17:10,164 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml' 2026-09-01T00:17:10,165 adding 'lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml' 2026-09-01T00:17:10,166 adding 'lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml' 2026-09-01T00:17:10,167 adding 'lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml' 2026-09-01T00:17:10,168 adding 'lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml' 2026-09-01T00:17:10,169 adding 'lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml' 2026-09-01T00:17:10,171 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml' 2026-09-01T00:17:10,172 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml' 2026-09-01T00:17:10,173 adding 'lm_eval/tasks/tmlu/default/utils.py' 2026-09-01T00:17:10,175 adding 'lm_eval/tasks/tmmluplus/README.md' 2026-09-01T00:17:10,176 adding 'lm_eval/tasks/tmmluplus/subject.tsv' 2026-09-01T00:17:10,180 adding 'lm_eval/tasks/tmmluplus/default/_generate_configs.py' 2026-09-01T00:17:10,181 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml' 2026-09-01T00:17:10,182 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml' 2026-09-01T00:17:10,183 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml' 2026-09-01T00:17:10,184 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml' 2026-09-01T00:17:10,185 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml' 2026-09-01T00:17:10,187 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml' 2026-09-01T00:17:10,188 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml' 2026-09-01T00:17:10,189 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml' 2026-09-01T00:17:10,190 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml' 2026-09-01T00:17:10,191 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml' 2026-09-01T00:17:10,193 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml' 2026-09-01T00:17:10,194 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml' 2026-09-01T00:17:10,195 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml' 2026-09-01T00:17:10,196 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml' 2026-09-01T00:17:10,198 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml' 2026-09-01T00:17:10,199 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml' 2026-09-01T00:17:10,200 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml' 2026-09-01T00:17:10,201 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml' 2026-09-01T00:17:10,202 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml' 2026-09-01T00:17:10,203 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml' 2026-09-01T00:17:10,205 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml' 2026-09-01T00:17:10,206 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml' 2026-09-01T00:17:10,207 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml' 2026-09-01T00:17:10,208 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml' 2026-09-01T00:17:10,209 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml' 2026-09-01T00:17:10,211 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml' 2026-09-01T00:17:10,212 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml' 2026-09-01T00:17:10,213 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml' 2026-09-01T00:17:10,214 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml' 2026-09-01T00:17:10,215 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml' 2026-09-01T00:17:10,217 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml' 2026-09-01T00:17:10,218 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml' 2026-09-01T00:17:10,219 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml' 2026-09-01T00:17:10,220 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml' 2026-09-01T00:17:10,221 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml' 2026-09-01T00:17:10,222 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml' 2026-09-01T00:17:10,223 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml' 2026-09-01T00:17:10,224 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml' 2026-09-01T00:17:10,226 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml' 2026-09-01T00:17:10,227 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml' 2026-09-01T00:17:10,228 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml' 2026-09-01T00:17:10,229 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml' 2026-09-01T00:17:10,230 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml' 2026-09-01T00:17:10,231 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml' 2026-09-01T00:17:10,232 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml' 2026-09-01T00:17:10,234 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml' 2026-09-01T00:17:10,235 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml' 2026-09-01T00:17:10,236 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml' 2026-09-01T00:17:10,237 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml' 2026-09-01T00:17:10,238 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml' 2026-09-01T00:17:10,239 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml' 2026-09-01T00:17:10,240 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml' 2026-09-01T00:17:10,241 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml' 2026-09-01T00:17:10,243 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml' 2026-09-01T00:17:10,244 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml' 2026-09-01T00:17:10,245 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml' 2026-09-01T00:17:10,246 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml' 2026-09-01T00:17:10,247 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml' 2026-09-01T00:17:10,249 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml' 2026-09-01T00:17:10,250 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml' 2026-09-01T00:17:10,251 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml' 2026-09-01T00:17:10,252 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml' 2026-09-01T00:17:10,253 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml' 2026-09-01T00:17:10,254 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml' 2026-09-01T00:17:10,256 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml' 2026-09-01T00:17:10,257 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml' 2026-09-01T00:17:10,258 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml' 2026-09-01T00:17:10,260 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml' 2026-09-01T00:17:10,261 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml' 2026-09-01T00:17:10,262 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml' 2026-09-01T00:17:10,263 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml' 2026-09-01T00:17:10,264 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml' 2026-09-01T00:17:10,266 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml' 2026-09-01T00:17:10,267 adding 'lm_eval/tasks/tmmluplus/default/utils.py' 2026-09-01T00:17:10,269 adding 'lm_eval/tasks/toksuite/README.md' 2026-09-01T00:17:10,271 adding 'lm_eval/tasks/toksuite/_toksuite_abridged.yaml' 2026-09-01T00:17:10,272 adding 'lm_eval/tasks/toksuite/_toksuite_all.yaml' 2026-09-01T00:17:10,274 adding 'lm_eval/tasks/toksuite/utils.py' 2026-09-01T00:17:10,276 adding 'lm_eval/tasks/toksuite/toksuite_chinese/_toksuite_chinese.yaml' 2026-09-01T00:17:10,278 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_base.yaml' 2026-09-01T00:17:10,279 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_canonical.yaml' 2026-09-01T00:17:10,280 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_code_language_script_switching.yaml' 2026-09-01T00:17:10,281 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_colloquial.yaml' 2026-09-01T00:17:10,282 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_equivalent_expressions.yaml' 2026-09-01T00:17:10,283 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_keyboard_proximity_errors.yaml' 2026-09-01T00:17:10,284 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_ocr_errors.yaml' 2026-09-01T00:17:10,286 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_optional_diacritics.yaml' 2026-09-01T00:17:10,287 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_partially_romanized.yaml' 2026-09-01T00:17:10,288 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_romanization.yaml' 2026-09-01T00:17:10,289 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_space_removal.yaml' 2026-09-01T00:17:10,290 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_spelled_out.yaml' 2026-09-01T00:17:10,291 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_traditional.yaml' 2026-09-01T00:17:10,292 adding 'lm_eval/tasks/toksuite/toksuite_chinese/toksuite_chinese_word_spacing_zero-width_characters_extra_space.yaml' 2026-09-01T00:17:10,294 adding 'lm_eval/tasks/toksuite/toksuite_english/_toksuite_english.yaml' 2026-09-01T00:17:10,296 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_abbreviations.yaml' 2026-09-01T00:17:10,297 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_base.yaml' 2026-09-01T00:17:10,298 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_canonical.yaml' 2026-09-01T00:17:10,299 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_capitalization.yaml' 2026-09-01T00:17:10,300 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_deletion.yaml' 2026-09-01T00:17:10,301 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_character_substitution.yaml' 2026-09-01T00:17:10,303 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_colloquial.yaml' 2026-09-01T00:17:10,304 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_compounds.yaml' 2026-09-01T00:17:10,305 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_contractions.yaml' 2026-09-01T00:17:10,306 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_date_formats.yaml' 2026-09-01T00:17:10,307 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_emoji_substitution.yaml' 2026-09-01T00:17:10,308 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_grammatical_errors.yaml' 2026-09-01T00:17:10,310 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_historical_spelling.yaml' 2026-09-01T00:17:10,311 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_homoglyphs.yaml' 2026-09-01T00:17:10,312 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_hyphenated_spelling.yaml' 2026-09-01T00:17:10,313 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_inflections.yaml' 2026-09-01T00:17:10,314 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_keyboard_proximity_errors.yaml' 2026-09-01T00:17:10,315 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_letter_repetition_for_emphasis.yaml' 2026-09-01T00:17:10,317 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_lowercase.yaml' 2026-09-01T00:17:10,318 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_macron_diacritic.yaml' 2026-09-01T00:17:10,319 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_ocr_errors.yaml' 2026-09-01T00:17:10,320 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_orthographic_errors.yaml' 2026-09-01T00:17:10,321 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_scripted_text.yaml' 2026-09-01T00:17:10,322 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_similar_words.yaml' 2026-09-01T00:17:10,323 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_space_removal.yaml' 2026-09-01T00:17:10,324 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spaced_styling.yaml' 2026-09-01T00:17:10,325 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_spelled_out.yaml' 2026-09-01T00:17:10,326 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_superscript_subscript_styling.yaml' 2026-09-01T00:17:10,327 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_web_search_query.yaml' 2026-09-01T00:17:10,328 adding 'lm_eval/tasks/toksuite/toksuite_english/toksuite_english_word_reordering.yaml' 2026-09-01T00:17:10,330 adding 'lm_eval/tasks/toksuite/toksuite_farsi/_toksuite_farsi.yaml' 2026-09-01T00:17:10,331 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_arabic_keyboard_for_farsi.yaml' 2026-09-01T00:17:10,333 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_base.yaml' 2026-09-01T00:17:10,334 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_canonical.yaml' 2026-09-01T00:17:10,335 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_code_language_script_switching.yaml' 2026-09-01T00:17:10,336 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_colloquial.yaml' 2026-09-01T00:17:10,337 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_dialects.yaml' 2026-09-01T00:17:10,338 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_equivalent_expressions.yaml' 2026-09-01T00:17:10,339 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_keyboard_proximity_errors.yaml' 2026-09-01T00:17:10,341 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_number_romanization.yaml' 2026-09-01T00:17:10,342 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_optional_diacritics.yaml' 2026-09-01T00:17:10,343 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_romanization.yaml' 2026-09-01T00:17:10,344 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_spelled_out.yaml' 2026-09-01T00:17:10,345 adding 'lm_eval/tasks/toksuite/toksuite_farsi/toksuite_farsi_word_spacing_zero-width_characters_extra_space.yaml' 2026-09-01T00:17:10,347 adding 'lm_eval/tasks/toksuite/toksuite_italian/_toksuite_italian.yaml' 2026-09-01T00:17:10,349 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_abbreviations.yaml' 2026-09-01T00:17:10,350 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_base.yaml' 2026-09-01T00:17:10,351 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_canonical.yaml' 2026-09-01T00:17:10,352 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_capitalization.yaml' 2026-09-01T00:17:10,353 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_code_language_script_switching.yaml' 2026-09-01T00:17:10,354 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_contractions.yaml' 2026-09-01T00:17:10,356 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_date_formats.yaml' 2026-09-01T00:17:10,357 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_dialects.yaml' 2026-09-01T00:17:10,358 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_english_keyboard.yaml' 2026-09-01T00:17:10,359 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_grammatical_errors.yaml' 2026-09-01T00:17:10,360 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_keyboard_proximity_errors.yaml' 2026-09-01T00:17:10,361 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_numerical_formats.yaml' 2026-09-01T00:17:10,362 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_orthographic_errors.yaml' 2026-09-01T00:17:10,363 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_phonetic_spelling.yaml' 2026-09-01T00:17:10,364 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_plausible_diacritics_errors.yaml' 2026-09-01T00:17:10,366 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_similar_words.yaml' 2026-09-01T00:17:10,367 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_spelled_out.yaml' 2026-09-01T00:17:10,368 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_typographical_errors.yaml' 2026-09-01T00:17:10,369 adding 'lm_eval/tasks/toksuite/toksuite_italian/toksuite_italian_web_search_query.yaml' 2026-09-01T00:17:10,371 adding 'lm_eval/tasks/toksuite/toksuite_math/_toksuite_math.yaml' 2026-09-01T00:17:10,372 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_base.yaml' 2026-09-01T00:17:10,373 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_canonical.yaml' 2026-09-01T00:17:10,374 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_chinese.yaml' 2026-09-01T00:17:10,375 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_decorative_unicode.yaml' 2026-09-01T00:17:10,376 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_farsi.yaml' 2026-09-01T00:17:10,377 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_italian.yaml' 2026-09-01T00:17:10,378 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_latex.yaml' 2026-09-01T00:17:10,379 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_space_removal.yaml' 2026-09-01T00:17:10,380 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_spelled_out.yaml' 2026-09-01T00:17:10,382 adding 'lm_eval/tasks/toksuite/toksuite_math/toksuite_math_turkish.yaml' 2026-09-01T00:17:10,384 adding 'lm_eval/tasks/toksuite/toksuite_stem/_toksuite_stem.yaml' 2026-09-01T00:17:10,385 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_base.yaml' 2026-09-01T00:17:10,386 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_canonical.yaml' 2026-09-01T00:17:10,387 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_character_deletion.yaml' 2026-09-01T00:17:10,388 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_colloquial.yaml' 2026-09-01T00:17:10,389 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_diacriticized_styling.yaml' 2026-09-01T00:17:10,390 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_double_struck.yaml' 2026-09-01T00:17:10,392 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_enclosed_characters.yaml' 2026-09-01T00:17:10,393 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_equivalent_expressions.yaml' 2026-09-01T00:17:10,394 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_fullwidth_characters.yaml' 2026-09-01T00:17:10,395 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_latex.yaml' 2026-09-01T00:17:10,396 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_morpheme_separation.yaml' 2026-09-01T00:17:10,398 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_scripted_text.yaml' 2026-09-01T00:17:10,399 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_space_removal.yaml' 2026-09-01T00:17:10,400 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_spelled_out.yaml' 2026-09-01T00:17:10,401 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_strikethrough.yaml' 2026-09-01T00:17:10,402 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_superscript_subscript.yaml' 2026-09-01T00:17:10,404 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_typographical_errors.yaml' 2026-09-01T00:17:10,405 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unicode_formatting.yaml' 2026-09-01T00:17:10,406 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_unusual_formatting.yaml' 2026-09-01T00:17:10,407 adding 'lm_eval/tasks/toksuite/toksuite_stem/toksuite_stem_upside_down_rotated.yaml' 2026-09-01T00:17:10,409 adding 'lm_eval/tasks/toksuite/toksuite_turkish/_toksuite_turkish.yaml' 2026-09-01T00:17:10,410 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_base.yaml' 2026-09-01T00:17:10,411 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_canonical.yaml' 2026-09-01T00:17:10,412 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_code_language_script_switching.yaml' 2026-09-01T00:17:10,413 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_colloquial.yaml' 2026-09-01T00:17:10,414 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_date_formats.yaml' 2026-09-01T00:17:10,416 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_derivations.yaml' 2026-09-01T00:17:10,417 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_dialects.yaml' 2026-09-01T00:17:10,418 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_english_keyboard.yaml' 2026-09-01T00:17:10,419 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_equivalent_expressions.yaml' 2026-09-01T00:17:10,420 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_grammatical_errors.yaml' 2026-09-01T00:17:10,421 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_inflections.yaml' 2026-09-01T00:17:10,422 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_keyboard_proximity_errors.yaml' 2026-09-01T00:17:10,423 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_orthographic_errors.yaml' 2026-09-01T00:17:10,425 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_similar_words.yaml' 2026-09-01T00:17:10,426 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_spelled_out.yaml' 2026-09-01T00:17:10,427 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_typographical_errors.yaml' 2026-09-01T00:17:10,428 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_web_search_query.yaml' 2026-09-01T00:17:10,429 adding 'lm_eval/tasks/toksuite/toksuite_turkish/toksuite_turkish_word_reordering.yaml' 2026-09-01T00:17:10,431 adding 'lm_eval/tasks/toxigen/README.md' 2026-09-01T00:17:10,432 adding 'lm_eval/tasks/toxigen/toxigen.yaml' 2026-09-01T00:17:10,433 adding 'lm_eval/tasks/toxigen/utils.py' 2026-09-01T00:17:10,435 adding 'lm_eval/tasks/translation/README.md' 2026-09-01T00:17:10,436 adding 'lm_eval/tasks/translation/iwslt2017_ar-en.yaml' 2026-09-01T00:17:10,437 adding 'lm_eval/tasks/translation/iwslt2017_en-ar.yaml' 2026-09-01T00:17:10,439 adding 'lm_eval/tasks/translation/utils.py' 2026-09-01T00:17:10,440 adding 'lm_eval/tasks/translation/wmt14_en-fr.yaml' 2026-09-01T00:17:10,441 adding 'lm_eval/tasks/translation/wmt14_fr-en.yaml' 2026-09-01T00:17:10,443 adding 'lm_eval/tasks/translation/wmt16_de-en.yaml' 2026-09-01T00:17:10,444 adding 'lm_eval/tasks/translation/wmt16_en-de.yaml' 2026-09-01T00:17:10,445 adding 'lm_eval/tasks/translation/wmt16_en-ro.yaml' 2026-09-01T00:17:10,446 adding 'lm_eval/tasks/translation/wmt16_ro-en.yaml' 2026-09-01T00:17:10,447 adding 'lm_eval/tasks/translation/wmt_common_yaml' 2026-09-01T00:17:10,449 adding 'lm_eval/tasks/triviaqa/README.md' 2026-09-01T00:17:10,450 adding 'lm_eval/tasks/triviaqa/default.yaml' 2026-09-01T00:17:10,452 adding 'lm_eval/tasks/truthfulqa/README.md' 2026-09-01T00:17:10,454 adding 'lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml' 2026-09-01T00:17:10,455 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml' 2026-09-01T00:17:10,456 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml' 2026-09-01T00:17:10,458 adding 'lm_eval/tasks/truthfulqa/utils.py' 2026-09-01T00:17:10,460 adding 'lm_eval/tasks/truthfulqa-multi/README.md' 2026-09-01T00:17:10,461 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_ca.yaml' 2026-09-01T00:17:10,462 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_common' 2026-09-01T00:17:10,463 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_en.yaml' 2026-09-01T00:17:10,464 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_es.yaml' 2026-09-01T00:17:10,465 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_eu.yaml' 2026-09-01T00:17:10,466 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_gen_gl.yaml' 2026-09-01T00:17:10,467 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_ca.yaml' 2026-09-01T00:17:10,468 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_en.yaml' 2026-09-01T00:17:10,469 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_es.yaml' 2026-09-01T00:17:10,470 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_eu.yaml' 2026-09-01T00:17:10,472 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc1_gl.yaml' 2026-09-01T00:17:10,473 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_ca.yaml' 2026-09-01T00:17:10,474 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_en.yaml' 2026-09-01T00:17:10,475 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_es.yaml' 2026-09-01T00:17:10,476 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_eu.yaml' 2026-09-01T00:17:10,477 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc2_gl.yaml' 2026-09-01T00:17:10,478 adding 'lm_eval/tasks/truthfulqa-multi/truthfulqa-multi_mc_common' 2026-09-01T00:17:10,480 adding 'lm_eval/tasks/truthfulqa-multi/utils.py' 2026-09-01T00:17:10,482 adding 'lm_eval/tasks/turblimp/README.md' 2026-09-01T00:17:10,483 adding 'lm_eval/tasks/turblimp/_template_yaml' 2026-09-01T00:17:10,484 adding 'lm_eval/tasks/turblimp/anaphor_agreement.yaml' 2026-09-01T00:17:10,486 adding 'lm_eval/tasks/turblimp/argument_structure_ditransitive.yaml' 2026-09-01T00:17:10,487 adding 'lm_eval/tasks/turblimp/argument_structure_transitive.yaml' 2026-09-01T00:17:10,488 adding 'lm_eval/tasks/turblimp/binding.yaml' 2026-09-01T00:17:10,489 adding 'lm_eval/tasks/turblimp/determiners.yaml' 2026-09-01T00:17:10,490 adding 'lm_eval/tasks/turblimp/ellipsis.yaml' 2026-09-01T00:17:10,491 adding 'lm_eval/tasks/turblimp/irregular_forms.yaml' 2026-09-01T00:17:10,492 adding 'lm_eval/tasks/turblimp/island_effects.yaml' 2026-09-01T00:17:10,493 adding 'lm_eval/tasks/turblimp/nominalization.yaml' 2026-09-01T00:17:10,495 adding 'lm_eval/tasks/turblimp/npi_licensing.yaml' 2026-09-01T00:17:10,496 adding 'lm_eval/tasks/turblimp/passives.yaml' 2026-09-01T00:17:10,497 adding 'lm_eval/tasks/turblimp/quantifiers.yaml' 2026-09-01T00:17:10,498 adding 'lm_eval/tasks/turblimp/relative_clauses.yaml' 2026-09-01T00:17:10,499 adding 'lm_eval/tasks/turblimp/scrambling.yaml' 2026-09-01T00:17:10,500 adding 'lm_eval/tasks/turblimp/subject_agreement.yaml' 2026-09-01T00:17:10,501 adding 'lm_eval/tasks/turblimp/suspended_affixation.yaml' 2026-09-01T00:17:10,503 adding 'lm_eval/tasks/turblimp/turblimp_group.yaml' 2026-09-01T00:17:10,505 adding 'lm_eval/tasks/turkishmmlu/README.md' 2026-09-01T00:17:10,507 adding 'lm_eval/tasks/turkishmmlu/config/Biology.yaml' 2026-09-01T00:17:10,508 adding 'lm_eval/tasks/turkishmmlu/config/Chemistry.yaml' 2026-09-01T00:17:10,509 adding 'lm_eval/tasks/turkishmmlu/config/Geography.yaml' 2026-09-01T00:17:10,510 adding 'lm_eval/tasks/turkishmmlu/config/History.yaml' 2026-09-01T00:17:10,511 adding 'lm_eval/tasks/turkishmmlu/config/Mathematics.yaml' 2026-09-01T00:17:10,512 adding 'lm_eval/tasks/turkishmmlu/config/Philosophy.yaml' 2026-09-01T00:17:10,513 adding 'lm_eval/tasks/turkishmmlu/config/Physics.yaml' 2026-09-01T00:17:10,515 adding 'lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml' 2026-09-01T00:17:10,516 adding 'lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml' 2026-09-01T00:17:10,517 adding 'lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml' 2026-09-01T00:17:10,519 adding 'lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml' 2026-09-01T00:17:10,521 adding 'lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml' 2026-09-01T00:17:10,523 adding 'lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml' 2026-09-01T00:17:10,524 adding 'lm_eval/tasks/turkishmmlu/config_cot/History.yaml' 2026-09-01T00:17:10,526 adding 'lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml' 2026-09-01T00:17:10,527 adding 'lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml' 2026-09-01T00:17:10,529 adding 'lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml' 2026-09-01T00:17:10,531 adding 'lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml' 2026-09-01T00:17:10,532 adding 'lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml' 2026-09-01T00:17:10,533 adding 'lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml' 2026-09-01T00:17:10,535 adding 'lm_eval/tasks/tydiqa/README.md' 2026-09-01T00:17:10,537 adding 'lm_eval/tasks/tydiqa/_tydiqa_goldp_common_yaml' 2026-09-01T00:17:10,538 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_ar.yaml' 2026-09-01T00:17:10,539 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_bn.yaml' 2026-09-01T00:17:10,540 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_en.yaml' 2026-09-01T00:17:10,541 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_fi.yaml' 2026-09-01T00:17:10,542 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_id.yaml' 2026-09-01T00:17:10,543 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_ko.yaml' 2026-09-01T00:17:10,544 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_ru.yaml' 2026-09-01T00:17:10,545 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_sw.yaml' 2026-09-01T00:17:10,547 adding 'lm_eval/tasks/tydiqa/tydiqa_goldp_te.yaml' 2026-09-01T00:17:10,548 adding 'lm_eval/tasks/tydiqa/utils.py' 2026-09-01T00:17:10,550 adding 'lm_eval/tasks/ulqa/README.md' 2026-09-01T00:17:10,551 adding 'lm_eval/tasks/ulqa/celep1.yaml' 2026-09-01T00:17:10,552 adding 'lm_eval/tasks/ulqa/celep2.yaml' 2026-09-01T00:17:10,553 adding 'lm_eval/tasks/ulqa/lambada_uyghur.yaml' 2026-09-01T00:17:10,555 adding 'lm_eval/tasks/ulqa/uleval.yaml' 2026-09-01T00:17:10,556 adding 'lm_eval/tasks/ulqa/ulqa.yaml' 2026-09-01T00:17:10,557 adding 'lm_eval/tasks/ulqa/ulqa_.yaml' 2026-09-01T00:17:10,559 adding 'lm_eval/tasks/ulqa/ulut/nug.yaml' 2026-09-01T00:17:10,560 adding 'lm_eval/tasks/ulqa/ulut/ulut.yaml' 2026-09-01T00:17:10,561 adding 'lm_eval/tasks/ulqa/ulut/wag.yaml' 2026-09-01T00:17:10,562 adding 'lm_eval/tasks/ulqa/ulut/wsm.yaml' 2026-09-01T00:17:10,564 adding 'lm_eval/tasks/ulqa/ulut/wub.yaml' 2026-09-01T00:17:10,565 adding 'lm_eval/tasks/ulqa/ulut/wum.yaml' 2026-09-01T00:17:10,567 adding 'lm_eval/tasks/uncheatable_eval/README.md' 2026-09-01T00:17:10,568 adding 'lm_eval/tasks/uncheatable_eval/_uncheatable_eval_base.yaml' 2026-09-01T00:17:10,569 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval.yaml' 2026-09-01T00:17:10,571 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_english.yaml' 2026-09-01T00:17:10,572 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_ao3_nonenglish.yaml' 2026-09-01T00:17:10,573 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_cs.yaml' 2026-09-01T00:17:10,574 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_math.yaml' 2026-09-01T00:17:10,575 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_other.yaml' 2026-09-01T00:17:10,576 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_arxiv_physics.yaml' 2026-09-01T00:17:10,578 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_bbc_news.yaml' 2026-09-01T00:17:10,579 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_biorxiv_all.yaml' 2026-09-01T00:17:10,580 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_cpp.yaml' 2026-09-01T00:17:10,581 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_javascript.yaml' 2026-09-01T00:17:10,582 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_markdown.yaml' 2026-09-01T00:17:10,584 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_other.yaml' 2026-09-01T00:17:10,585 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_github_python.yaml' 2026-09-01T00:17:10,586 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_utils.py' 2026-09-01T00:17:10,587 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_english.yaml' 2026-09-01T00:17:10,588 adding 'lm_eval/tasks/uncheatable_eval/uncheatable_eval_wikipedia_nonenglish.yaml' 2026-09-01T00:17:10,590 adding 'lm_eval/tasks/unitxt/20_newsgroups.yaml' 2026-09-01T00:17:10,591 adding 'lm_eval/tasks/unitxt/README.md' 2026-09-01T00:17:10,592 adding 'lm_eval/tasks/unitxt/ag_news.yaml' 2026-09-01T00:17:10,593 adding 'lm_eval/tasks/unitxt/argument_topic.yaml' 2026-09-01T00:17:10,594 adding 'lm_eval/tasks/unitxt/atis.yaml' 2026-09-01T00:17:10,595 adding 'lm_eval/tasks/unitxt/banking77.yaml' 2026-09-01T00:17:10,596 adding 'lm_eval/tasks/unitxt/claim_stance_topic.yaml' 2026-09-01T00:17:10,598 adding 'lm_eval/tasks/unitxt/cnn_dailymail.yaml' 2026-09-01T00:17:10,599 adding 'lm_eval/tasks/unitxt/coedit_gec.yaml' 2026-09-01T00:17:10,600 adding 'lm_eval/tasks/unitxt/dbpedia_14.yaml' 2026-09-01T00:17:10,601 adding 'lm_eval/tasks/unitxt/doc_vqa.yaml' 2026-09-01T00:17:10,602 adding 'lm_eval/tasks/unitxt/ethos_binary.yaml' 2026-09-01T00:17:10,603 adding 'lm_eval/tasks/unitxt/financial_tweets.yaml' 2026-09-01T00:17:10,604 adding 'lm_eval/tasks/unitxt/law_stack_exchange.yaml' 2026-09-01T00:17:10,605 adding 'lm_eval/tasks/unitxt/ledgar.yaml' 2026-09-01T00:17:10,606 adding 'lm_eval/tasks/unitxt/medical_abstracts.yaml' 2026-09-01T00:17:10,607 adding 'lm_eval/tasks/unitxt/stsb.yaml' 2026-09-01T00:17:10,609 adding 'lm_eval/tasks/unitxt/task.py' 2026-09-01T00:17:10,610 adding 'lm_eval/tasks/unitxt/unfair_tos.yaml' 2026-09-01T00:17:10,611 adding 'lm_eval/tasks/unitxt/unitxt' 2026-09-01T00:17:10,612 adding 'lm_eval/tasks/unitxt/unitxt_multimodal' 2026-09-01T00:17:10,613 adding 'lm_eval/tasks/unitxt/xsum.yaml' 2026-09-01T00:17:10,615 adding 'lm_eval/tasks/unitxt/yahoo_answers_topics.yaml' 2026-09-01T00:17:10,616 adding 'lm_eval/tasks/unscramble/README.md' 2026-09-01T00:17:10,618 adding 'lm_eval/tasks/unscramble/anagrams1.yaml' 2026-09-01T00:17:10,619 adding 'lm_eval/tasks/unscramble/anagrams2.yaml' 2026-09-01T00:17:10,620 adding 'lm_eval/tasks/unscramble/cycle_letters.yaml' 2026-09-01T00:17:10,621 adding 'lm_eval/tasks/unscramble/random_insertion.yaml' 2026-09-01T00:17:10,622 adding 'lm_eval/tasks/unscramble/reversed_words.yaml' 2026-09-01T00:17:10,624 adding 'lm_eval/tasks/webqs/README.md' 2026-09-01T00:17:10,625 adding 'lm_eval/tasks/webqs/utils.py' 2026-09-01T00:17:10,627 adding 'lm_eval/tasks/webqs/webqs.yaml' 2026-09-01T00:17:10,628 adding 'lm_eval/tasks/wikitext/README.md' 2026-09-01T00:17:10,630 adding 'lm_eval/tasks/wikitext/preprocess_wikitext.py' 2026-09-01T00:17:10,631 adding 'lm_eval/tasks/wikitext/wikitext.yaml' 2026-09-01T00:17:10,633 adding 'lm_eval/tasks/winogender/README.md' 2026-09-01T00:17:10,634 adding 'lm_eval/tasks/winogender/utils.py' 2026-09-01T00:17:10,635 adding 'lm_eval/tasks/winogender/winogender.yaml' 2026-09-01T00:17:10,636 adding 'lm_eval/tasks/winogender/winogender_female.yaml' 2026-09-01T00:17:10,637 adding 'lm_eval/tasks/winogender/winogender_gotcha.yaml' 2026-09-01T00:17:10,639 adding 'lm_eval/tasks/winogender/winogender_gotcha_female.yaml' 2026-09-01T00:17:10,640 adding 'lm_eval/tasks/winogender/winogender_gotcha_male.yaml' 2026-09-01T00:17:10,641 adding 'lm_eval/tasks/winogender/winogender_male.yaml' 2026-09-01T00:17:10,642 adding 'lm_eval/tasks/winogender/winogender_neutral.yaml' 2026-09-01T00:17:10,644 adding 'lm_eval/tasks/winogrande/README.md' 2026-09-01T00:17:10,645 adding 'lm_eval/tasks/winogrande/default.yaml' 2026-09-01T00:17:10,646 adding 'lm_eval/tasks/winogrande/preprocess_winogrande.py' 2026-09-01T00:17:10,648 adding 'lm_eval/tasks/wmdp/README.md' 2026-09-01T00:17:10,649 adding 'lm_eval/tasks/wmdp/_default_template_yaml' 2026-09-01T00:17:10,650 adding 'lm_eval/tasks/wmdp/_wmdp.yaml' 2026-09-01T00:17:10,651 adding 'lm_eval/tasks/wmdp/wmdp_bio.yaml' 2026-09-01T00:17:10,652 adding 'lm_eval/tasks/wmdp/wmdp_chem.yaml' 2026-09-01T00:17:10,653 adding 'lm_eval/tasks/wmdp/wmdp_cyber.yaml' 2026-09-01T00:17:10,655 adding 'lm_eval/tasks/wmt2016/README.md' 2026-09-01T00:17:10,656 adding 'lm_eval/tasks/wmt2016/metrics.py' 2026-09-01T00:17:10,657 adding 'lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml' 2026-09-01T00:17:10,659 adding 'lm_eval/tasks/wsc273/README.md' 2026-09-01T00:17:10,660 adding 'lm_eval/tasks/wsc273/default.yaml' 2026-09-01T00:17:10,661 adding 'lm_eval/tasks/wsc273/utils.py' 2026-09-01T00:17:10,663 adding 'lm_eval/tasks/xcopa/README.md' 2026-09-01T00:17:10,664 adding 'lm_eval/tasks/xcopa/_xcopa.yaml' 2026-09-01T00:17:10,665 adding 'lm_eval/tasks/xcopa/default_et.yaml' 2026-09-01T00:17:10,666 adding 'lm_eval/tasks/xcopa/default_ht.yaml' 2026-09-01T00:17:10,667 adding 'lm_eval/tasks/xcopa/default_id.yaml' 2026-09-01T00:17:10,668 adding 'lm_eval/tasks/xcopa/default_it.yaml' 2026-09-01T00:17:10,669 adding 'lm_eval/tasks/xcopa/default_qu.yaml' 2026-09-01T00:17:10,671 adding 'lm_eval/tasks/xcopa/default_sw.yaml' 2026-09-01T00:17:10,672 adding 'lm_eval/tasks/xcopa/default_ta.yaml' 2026-09-01T00:17:10,673 adding 'lm_eval/tasks/xcopa/default_th.yaml' 2026-09-01T00:17:10,674 adding 'lm_eval/tasks/xcopa/default_tr.yaml' 2026-09-01T00:17:10,675 adding 'lm_eval/tasks/xcopa/default_vi.yaml' 2026-09-01T00:17:10,676 adding 'lm_eval/tasks/xcopa/default_zh.yaml' 2026-09-01T00:17:10,677 adding 'lm_eval/tasks/xcopa/utils.py' 2026-09-01T00:17:10,679 adding 'lm_eval/tasks/xnli/README.md' 2026-09-01T00:17:10,680 adding 'lm_eval/tasks/xnli/_xnli.yaml' 2026-09-01T00:17:10,682 adding 'lm_eval/tasks/xnli/utils.py' 2026-09-01T00:17:10,683 adding 'lm_eval/tasks/xnli/xnli_ar.yaml' 2026-09-01T00:17:10,684 adding 'lm_eval/tasks/xnli/xnli_bg.yaml' 2026-09-01T00:17:10,685 adding 'lm_eval/tasks/xnli/xnli_common_yaml' 2026-09-01T00:17:10,687 adding 'lm_eval/tasks/xnli/xnli_de.yaml' 2026-09-01T00:17:10,688 adding 'lm_eval/tasks/xnli/xnli_el.yaml' 2026-09-01T00:17:10,689 adding 'lm_eval/tasks/xnli/xnli_en.yaml' 2026-09-01T00:17:10,690 adding 'lm_eval/tasks/xnli/xnli_es.yaml' 2026-09-01T00:17:10,691 adding 'lm_eval/tasks/xnli/xnli_fr.yaml' 2026-09-01T00:17:10,692 adding 'lm_eval/tasks/xnli/xnli_hi.yaml' 2026-09-01T00:17:10,693 adding 'lm_eval/tasks/xnli/xnli_ru.yaml' 2026-09-01T00:17:10,695 adding 'lm_eval/tasks/xnli/xnli_sw.yaml' 2026-09-01T00:17:10,696 adding 'lm_eval/tasks/xnli/xnli_th.yaml' 2026-09-01T00:17:10,697 adding 'lm_eval/tasks/xnli/xnli_tr.yaml' 2026-09-01T00:17:10,698 adding 'lm_eval/tasks/xnli/xnli_ur.yaml' 2026-09-01T00:17:10,699 adding 'lm_eval/tasks/xnli/xnli_vi.yaml' 2026-09-01T00:17:10,700 adding 'lm_eval/tasks/xnli/xnli_zh.yaml' 2026-09-01T00:17:10,702 adding 'lm_eval/tasks/xnli_eu/README.md' 2026-09-01T00:17:10,704 adding 'lm_eval/tasks/xnli_eu/xnli_common_yaml' 2026-09-01T00:17:10,705 adding 'lm_eval/tasks/xnli_eu/xnli_eu.yaml' 2026-09-01T00:17:10,706 adding 'lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml' 2026-09-01T00:17:10,707 adding 'lm_eval/tasks/xnli_eu/xnli_eu_native.yaml' 2026-09-01T00:17:10,709 adding 'lm_eval/tasks/xquad/README.md' 2026-09-01T00:17:10,710 adding 'lm_eval/tasks/xquad/utils.py' 2026-09-01T00:17:10,712 adding 'lm_eval/tasks/xquad/xquad_ar.yaml' 2026-09-01T00:17:10,713 adding 'lm_eval/tasks/xquad/xquad_common_yaml' 2026-09-01T00:17:10,714 adding 'lm_eval/tasks/xquad/xquad_de.yaml' 2026-09-01T00:17:10,715 adding 'lm_eval/tasks/xquad/xquad_el.yaml' 2026-09-01T00:17:10,716 adding 'lm_eval/tasks/xquad/xquad_en.yaml' 2026-09-01T00:17:10,717 adding 'lm_eval/tasks/xquad/xquad_es.yaml' 2026-09-01T00:17:10,718 adding 'lm_eval/tasks/xquad/xquad_hi.yaml' 2026-09-01T00:17:10,720 adding 'lm_eval/tasks/xquad/xquad_ro.yaml' 2026-09-01T00:17:10,721 adding 'lm_eval/tasks/xquad/xquad_ru.yaml' 2026-09-01T00:17:10,722 adding 'lm_eval/tasks/xquad/xquad_th.yaml' 2026-09-01T00:17:10,723 adding 'lm_eval/tasks/xquad/xquad_tr.yaml' 2026-09-01T00:17:10,724 adding 'lm_eval/tasks/xquad/xquad_vi.yaml' 2026-09-01T00:17:10,725 adding 'lm_eval/tasks/xquad/xquad_zh.yaml' 2026-09-01T00:17:10,727 adding 'lm_eval/tasks/xstorycloze/README.md' 2026-09-01T00:17:10,728 adding 'lm_eval/tasks/xstorycloze/_xstorycloze.yaml' 2026-09-01T00:17:10,729 adding 'lm_eval/tasks/xstorycloze/default_ar.yaml' 2026-09-01T00:17:10,730 adding 'lm_eval/tasks/xstorycloze/default_en.yaml' 2026-09-01T00:17:10,731 adding 'lm_eval/tasks/xstorycloze/default_es.yaml' 2026-09-01T00:17:10,732 adding 'lm_eval/tasks/xstorycloze/default_eu.yaml' 2026-09-01T00:17:10,733 adding 'lm_eval/tasks/xstorycloze/default_hi.yaml' 2026-09-01T00:17:10,734 adding 'lm_eval/tasks/xstorycloze/default_id.yaml' 2026-09-01T00:17:10,735 adding 'lm_eval/tasks/xstorycloze/default_my.yaml' 2026-09-01T00:17:10,736 adding 'lm_eval/tasks/xstorycloze/default_ru.yaml' 2026-09-01T00:17:10,738 adding 'lm_eval/tasks/xstorycloze/default_sw.yaml' 2026-09-01T00:17:10,739 adding 'lm_eval/tasks/xstorycloze/default_te.yaml' 2026-09-01T00:17:10,740 adding 'lm_eval/tasks/xstorycloze/default_zh.yaml' 2026-09-01T00:17:10,742 adding 'lm_eval/tasks/xwinograd/README.md' 2026-09-01T00:17:10,743 adding 'lm_eval/tasks/xwinograd/_xwinograd.yaml' 2026-09-01T00:17:10,744 adding 'lm_eval/tasks/xwinograd/utils.py' 2026-09-01T00:17:10,745 adding 'lm_eval/tasks/xwinograd/xwinograd_common_yaml' 2026-09-01T00:17:10,746 adding 'lm_eval/tasks/xwinograd/xwinograd_en.yaml' 2026-09-01T00:17:10,747 adding 'lm_eval/tasks/xwinograd/xwinograd_fr.yaml' 2026-09-01T00:17:10,748 adding 'lm_eval/tasks/xwinograd/xwinograd_jp.yaml' 2026-09-01T00:17:10,750 adding 'lm_eval/tasks/xwinograd/xwinograd_pt.yaml' 2026-09-01T00:17:10,751 adding 'lm_eval/tasks/xwinograd/xwinograd_ru.yaml' 2026-09-01T00:17:10,752 adding 'lm_eval/tasks/xwinograd/xwinograd_zh.yaml' 2026-09-01T00:17:10,755 adding 'lm_eval/tasks/zhoblimp/BA_BEI_subj_drop.yaml' 2026-09-01T00:17:10,757 adding 'lm_eval/tasks/zhoblimp/BA_deletion.yaml' 2026-09-01T00:17:10,758 adding 'lm_eval/tasks/zhoblimp/BA_duplicate_argument.yaml' 2026-09-01T00:17:10,759 adding 'lm_eval/tasks/zhoblimp/BA_inversion.yaml' 2026-09-01T00:17:10,760 adding 'lm_eval/tasks/zhoblimp/BA_meiba.yaml' 2026-09-01T00:17:10,761 adding 'lm_eval/tasks/zhoblimp/BA_negation.yaml' 2026-09-01T00:17:10,762 adding 'lm_eval/tasks/zhoblimp/BA_no_progressive.yaml' 2026-09-01T00:17:10,763 adding 'lm_eval/tasks/zhoblimp/BA_no_stative_verb.yaml' 2026-09-01T00:17:10,764 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_a.yaml' 2026-09-01T00:17:10,765 adding 'lm_eval/tasks/zhoblimp/BA_suo_adverbial_b.yaml' 2026-09-01T00:17:10,767 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_a.yaml' 2026-09-01T00:17:10,768 adding 'lm_eval/tasks/zhoblimp/BA_verb_le_b.yaml' 2026-09-01T00:17:10,769 adding 'lm_eval/tasks/zhoblimp/BEI_construction_a.yaml' 2026-09-01T00:17:10,770 adding 'lm_eval/tasks/zhoblimp/BEI_construction_b.yaml' 2026-09-01T00:17:10,771 adding 'lm_eval/tasks/zhoblimp/BEI_deletion.yaml' 2026-09-01T00:17:10,772 adding 'lm_eval/tasks/zhoblimp/BEI_preposition.yaml' 2026-09-01T00:17:10,773 adding 'lm_eval/tasks/zhoblimp/PN_numP_a.yaml' 2026-09-01T00:17:10,774 adding 'lm_eval/tasks/zhoblimp/PN_numP_b.yaml' 2026-09-01T00:17:10,776 adding 'lm_eval/tasks/zhoblimp/README.md' 2026-09-01T00:17:10,777 adding 'lm_eval/tasks/zhoblimp/_template_yaml' 2026-09-01T00:17:10,778 adding 'lm_eval/tasks/zhoblimp/adjective_transitive_dui.yaml' 2026-09-01T00:17:10,779 adding 'lm_eval/tasks/zhoblimp/agent_animacy_adv.yaml' 2026-09-01T00:17:10,780 adding 'lm_eval/tasks/zhoblimp/agent_animacy_passive.yaml' 2026-09-01T00:17:10,781 adding 'lm_eval/tasks/zhoblimp/agent_animacy_subj.yaml' 2026-09-01T00:17:10,783 adding 'lm_eval/tasks/zhoblimp/agent_causative.yaml' 2026-09-01T00:17:10,784 adding 'lm_eval/tasks/zhoblimp/agent_deletion.yaml' 2026-09-01T00:17:10,785 adding 'lm_eval/tasks/zhoblimp/anaphor_gender_agreement.yaml' 2026-09-01T00:17:10,786 adding 'lm_eval/tasks/zhoblimp/anaphor_number_agreement.yaml' 2026-09-01T00:17:10,787 adding 'lm_eval/tasks/zhoblimp/causative_shi_ba.yaml' 2026-09-01T00:17:10,788 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement.yaml' 2026-09-01T00:17:10,789 adding 'lm_eval/tasks/zhoblimp/classifier_noun_agreement_no_gap.yaml' 2026-09-01T00:17:10,790 adding 'lm_eval/tasks/zhoblimp/classifier_noun_subj.yaml' 2026-09-01T00:17:10,791 adding 'lm_eval/tasks/zhoblimp/control_modal_vs_raising_modal.yaml' 2026-09-01T00:17:10,792 adding 'lm_eval/tasks/zhoblimp/ellipsis_adj.yaml' 2026-09-01T00:17:10,793 adding 'lm_eval/tasks/zhoblimp/ellipsis_double_object.yaml' 2026-09-01T00:17:10,794 adding 'lm_eval/tasks/zhoblimp/ellipsis_n_bar_class.yaml' 2026-09-01T00:17:10,795 adding 'lm_eval/tasks/zhoblimp/existential_there_subject_raising.yaml' 2026-09-01T00:17:10,796 adding 'lm_eval/tasks/zhoblimp/fci_renhe_dou.yaml' 2026-09-01T00:17:10,797 adding 'lm_eval/tasks/zhoblimp/fci_renhe_prepP.yaml' 2026-09-01T00:17:10,798 adding 'lm_eval/tasks/zhoblimp/fci_renhe_ruguo.yaml' 2026-09-01T00:17:10,800 adding 'lm_eval/tasks/zhoblimp/fci_renhe_subj.yaml' 2026-09-01T00:17:10,801 adding 'lm_eval/tasks/zhoblimp/fci_renhe_suoyou.yaml' 2026-09-01T00:17:10,802 adding 'lm_eval/tasks/zhoblimp/intransitive_double_obj.yaml' 2026-09-01T00:17:10,803 adding 'lm_eval/tasks/zhoblimp/intransitive_no_obj.yaml' 2026-09-01T00:17:10,804 adding 'lm_eval/tasks/zhoblimp/left_adverbial_b.yaml' 2026-09-01T00:17:10,805 adding 'lm_eval/tasks/zhoblimp/left_adverbial_d.yaml' 2026-09-01T00:17:10,806 adding 'lm_eval/tasks/zhoblimp/left_adverbial_e.yaml' 2026-09-01T00:17:10,807 adding 'lm_eval/tasks/zhoblimp/left_adverbial_negation.yaml' 2026-09-01T00:17:10,808 adding 'lm_eval/tasks/zhoblimp/left_dou.yaml' 2026-09-01T00:17:10,809 adding 'lm_eval/tasks/zhoblimp/modal_raising_hui.yaml' 2026-09-01T00:17:10,810 adding 'lm_eval/tasks/zhoblimp/modal_raising_topicalization.yaml' 2026-09-01T00:17:10,812 adding 'lm_eval/tasks/zhoblimp/nominal_definite_men.yaml' 2026-09-01T00:17:10,813 adding 'lm_eval/tasks/zhoblimp/nominal_modal_insertion.yaml' 2026-09-01T00:17:10,814 adding 'lm_eval/tasks/zhoblimp/noun_adjective_shi.yaml' 2026-09-01T00:17:10,815 adding 'lm_eval/tasks/zhoblimp/noun_phrase_conjunction_jian.yaml' 2026-09-01T00:17:10,816 adding 'lm_eval/tasks/zhoblimp/npi_renhe_A_not_A_question.yaml' 2026-09-01T00:17:10,817 adding 'lm_eval/tasks/zhoblimp/npi_renhe_conditional.yaml' 2026-09-01T00:17:10,818 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_locP.yaml' 2026-09-01T00:17:10,819 adding 'lm_eval/tasks/zhoblimp/npi_renhe_neg_scope_subj.yaml' 2026-09-01T00:17:10,820 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_obj.yaml' 2026-09-01T00:17:10,822 adding 'lm_eval/tasks/zhoblimp/npi_renhe_wh_question_subj.yaml' 2026-09-01T00:17:10,823 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_left.yaml' 2026-09-01T00:17:10,824 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_a.yaml' 2026-09-01T00:17:10,825 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_long_right_b.yaml' 2026-09-01T00:17:10,826 adding 'lm_eval/tasks/zhoblimp/passive_agent_deletion_short.yaml' 2026-09-01T00:17:10,827 adding 'lm_eval/tasks/zhoblimp/passive_body_part.yaml' 2026-09-01T00:17:10,828 adding 'lm_eval/tasks/zhoblimp/passive_intransitive.yaml' 2026-09-01T00:17:10,830 adding 'lm_eval/tasks/zhoblimp/passive_no_adj.yaml' 2026-09-01T00:17:10,831 adding 'lm_eval/tasks/zhoblimp/passive_suo.yaml' 2026-09-01T00:17:10,832 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_a.yaml' 2026-09-01T00:17:10,833 adding 'lm_eval/tasks/zhoblimp/plural_cardinal_men_b.yaml' 2026-09-01T00:17:10,834 adding 'lm_eval/tasks/zhoblimp/preposition_deletion.yaml' 2026-09-01T00:17:10,835 adding 'lm_eval/tasks/zhoblimp/preposition_insertion.yaml' 2026-09-01T00:17:10,836 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command.yaml' 2026-09-01T00:17:10,838 adding 'lm_eval/tasks/zhoblimp/principle_A_c_command_number.yaml' 2026-09-01T00:17:10,839 adding 'lm_eval/tasks/zhoblimp/principle_A_domain.yaml' 2026-09-01T00:17:10,840 adding 'lm_eval/tasks/zhoblimp/principle_A_domain_number.yaml' 2026-09-01T00:17:10,841 adding 'lm_eval/tasks/zhoblimp/question_A_not_A.yaml' 2026-09-01T00:17:10,842 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_a.yaml' 2026-09-01T00:17:10,843 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_daodi_b.yaml' 2026-09-01T00:17:10,844 adding 'lm_eval/tasks/zhoblimp/question_A_not_A_indirect.yaml' 2026-09-01T00:17:10,845 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_1.yaml' 2026-09-01T00:17:10,846 adding 'lm_eval/tasks/zhoblimp/question_V_not_VP_2.yaml' 2026-09-01T00:17:10,847 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_1.yaml' 2026-09-01T00:17:10,848 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_2.yaml' 2026-09-01T00:17:10,849 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_intran.yaml' 2026-09-01T00:17:10,850 adding 'lm_eval/tasks/zhoblimp/question_daodi_nandao_A_not_A_tran.yaml' 2026-09-01T00:17:10,851 adding 'lm_eval/tasks/zhoblimp/question_daodi_negation.yaml' 2026-09-01T00:17:10,852 adding 'lm_eval/tasks/zhoblimp/question_nandao_negation.yaml' 2026-09-01T00:17:10,853 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_a.yaml' 2026-09-01T00:17:10,854 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_1_b.yaml' 2026-09-01T00:17:10,856 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_2.yaml' 2026-09-01T00:17:10,857 adding 'lm_eval/tasks/zhoblimp/question_nandao_raising_3.yaml' 2026-09-01T00:17:10,858 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_1.yaml' 2026-09-01T00:17:10,859 adding 'lm_eval/tasks/zhoblimp/question_nandao_scope_2.yaml' 2026-09-01T00:17:10,860 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_intran.yaml' 2026-09-01T00:17:10,861 adding 'lm_eval/tasks/zhoblimp/question_particle_daodi_choice_tran.yaml' 2026-09-01T00:17:10,862 adding 'lm_eval/tasks/zhoblimp/question_particle_nandao.yaml' 2026-09-01T00:17:10,863 adding 'lm_eval/tasks/zhoblimp/relative_operator_intepretation.yaml' 2026-09-01T00:17:10,864 adding 'lm_eval/tasks/zhoblimp/relative_operator_who.yaml' 2026-09-01T00:17:10,865 adding 'lm_eval/tasks/zhoblimp/relativization_movement_no_gap.yaml' 2026-09-01T00:17:10,866 adding 'lm_eval/tasks/zhoblimp/relativization_movement_when_where.yaml' 2026-09-01T00:17:10,868 adding 'lm_eval/tasks/zhoblimp/renhe_no_episodic_sentences.yaml' 2026-09-01T00:17:10,869 adding 'lm_eval/tasks/zhoblimp/renhe_no_superordinate_negation.yaml' 2026-09-01T00:17:10,870 adding 'lm_eval/tasks/zhoblimp/renhe_non_factive_verb.yaml' 2026-09-01T00:17:10,871 adding 'lm_eval/tasks/zhoblimp/right_yijing_a.yaml' 2026-09-01T00:17:10,872 adding 'lm_eval/tasks/zhoblimp/right_yijing_b.yaml' 2026-09-01T00:17:10,873 adding 'lm_eval/tasks/zhoblimp/singular_PN_but_plural_pron.yaml' 2026-09-01T00:17:10,874 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_1.yaml' 2026-09-01T00:17:10,876 adding 'lm_eval/tasks/zhoblimp/superlative_quantifiers_2.yaml' 2026-09-01T00:17:10,877 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV.yaml' 2026-09-01T00:17:10,878 adding 'lm_eval/tasks/zhoblimp/topicalization_OSV_mei.yaml' 2026-09-01T00:17:10,879 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV.yaml' 2026-09-01T00:17:10,880 adding 'lm_eval/tasks/zhoblimp/topicalization_SOV_mei.yaml' 2026-09-01T00:17:10,881 adding 'lm_eval/tasks/zhoblimp/verb_negation_particle.yaml' 2026-09-01T00:17:10,882 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_adverbial.yaml' 2026-09-01T00:17:10,884 adding 'lm_eval/tasks/zhoblimp/verb_phrase_left_negation.yaml' 2026-09-01T00:17:10,885 adding 'lm_eval/tasks/zhoblimp/ya_insertion.yaml' 2026-09-01T00:17:10,886 adding 'lm_eval/tasks/zhoblimp/you_quantifier_adj.yaml' 2026-09-01T00:17:10,887 adding 'lm_eval/tasks/zhoblimp/you_yige.yaml' 2026-09-01T00:17:10,888 adding 'lm_eval/tasks/zhoblimp/zhoblimp_group.yaml' 2026-09-01T00:17:10,891 adding 'lm_eval-0.4.13.dev0.dist-info/licenses/LICENSE.md' 2026-09-01T00:17:10,898 adding 'lm_eval-0.4.13.dev0.dist-info/METADATA' 2026-09-01T00:17:10,899 adding 'lm_eval-0.4.13.dev0.dist-info/WHEEL' 2026-09-01T00:17:10,900 adding 'lm_eval-0.4.13.dev0.dist-info/entry_points.txt' 2026-09-01T00:17:10,901 adding 'lm_eval-0.4.13.dev0.dist-info/top_level.txt' 2026-09-01T00:17:11,167 adding 'lm_eval-0.4.13.dev0.dist-info/RECORD' 2026-09-01T00:17:11,426 removing build/bdist.linux-armv7l/wheel 2026-09-01T00:17:15,451 Building wheel for lm-eval (pyproject.toml): finished with status 'done' 2026-09-01T00:17:15,636 Created wheel for lm-eval: filename=lm_eval-0.4.13.dev0-py3-none-any.whl size=9149452 sha256=8e343cfaee8e4c15c7887120bf59466f130caa94b33960ecb859e529bfc298aa 2026-09-01T00:17:15,637 Stored in directory: /tmp/pip-ephem-wheel-cache-0m8nbhch/wheels/f3/5a/93/014716202662d1316bb3847c79b52c4f3909885cf32379f22f 2026-09-01T00:17:16,134 Successfully built lm-eval 2026-09-01T00:17:16,327 Removed build tracker: '/tmp/pip-build-tracker-6udn2v18'